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Real Party in Interest 

BearingPoint, Inc., currently owns this Application. An assignment recorded 30 October 
2003 in the Assignment Records of the United States Patent and Trademark Office at Reel 
014658, Frame 0275, indicates BearingPoint, Inc. currently owns this Application. 
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Related Appeals and Interferences 

No known appeals, interferences, or judicial proceedings are related to or will directly 
affect or have a bearing on the Board's decision on this Appeal. The Board's decision on this 
Appeal will not affect any known appeals, interferences, or judicial proceedings. 
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Status of Claims 

Claims 1-20 are pending in this Application and all stand finally rejected under the Office 
Action sent 13 September 2007. Appellant presents all pending claims for appeal. The attached 
Claims Appendix shows all pending claims. 
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Status of Amendments 

The Examiner has entered all amendments submitted by Appellant. 
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Summary of Claimed Subject Matter 

FIGURE 1 illustrates an example system 10 for facilitating software engineering and 
management in connection with a software development project according to a process that is 
compliant with a qualitatively measurable standard. (Page 6, Lines 2-4). An example of a 
qualitatively measurable standard includes one or more maturity levels (MLs) of a software 
capability maturity model (SW-CMM), such as the Software Engineering Institute's (SEI's) 
Software Capability Maturity Model (SW-CMM). (Page 6, Lines 4-6). An ML of an SW-CMM 
may include multiple key process areas (KPAs). (Page 6, Lines 6-7). A KPA may be an area of 
focus for improving an organization's software processes. (Page 6, Lines 7-8). A process may 
include a sequence of steps performed for a given purpose (such as software development). 
(Page 6, Lines 8-9). An organization may include an entity (such as an enterprise) that 
undertakes projects (such as software development projects). (Page 6, Lines 9-1 1). Associated 
with a KPA are goals and common features. (Page 6, Line 11). A goal may be associated with 
enhancing process capabilities, and an organization may be required to achieve all goals 
associated with a KPA to satisfy the KPA. (Page 6, Lines 11-13). A common feature associated 
with a KPA may be an attribute that indicates whether an organization has implemented the 
KPA. (Page 6, Lines 13-15). Associated with a common feature of a KPA are one or more KPs 
that include activities, infrastructure, or both that contribute to reaching goals associated with the 
KPA. (Page 6, Lines 15-17). A KP may include one or more subpractices, according to 
particular needs. (Page 6, Lines 17-18). 
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As an example and not by way of limitation, an organization that has reached ML2 of the 
SEI's SW-CMM is capable of successfully planning, performing, and managing software 
projects. (Page 6, Lines 19-21). In addition, the organization has a software process that is 
repeatable. (Page 6, Lines 12-22). An organization that has reached ML3 of the SEI's SW- 
CMM has derived, from past successful software projects, "best practices" for planning, 
performing, and managing software projects. (Page 6, Lines 22-24). In addition, the 
organization has documented these best practices in an OSSP. (Page 6, Lines 24-25). An OSSP 
may include an operational definition of a best process that guides establishment of a common 
software process across software projects of an organization and a description of fiindamental 
software-process elements that are to be incorporated into projects' defined software processes 
(PDSPs) of the organization. (Page 6, Lines 25-29). 

System 10 includes a server system 12 that provides one or more users at one or more 
client systems 14 access to one or more resource databases 16 that include one or more resource 
sets 18. (Page 7, Lines 18-20). The components of system 10 may communicate with each other 
using one or more links that may each include one or more computer buses, local area networks 
(LANs), metropolitan area network (MANs), wide area networks (WANs), portions of the 
Internet, or other wireline, optical, wireless, or other links. (Page 7, Lines 20-24). Server system 
12 may include one or more appropriate computer systems (which may be geographically 
separated from each other) that may collectively receive a resource request fi:om a client system 
14 and, in response to the resource request, access one or more resources firom one or more 
resource sets 18 and communicate the accessed resources to client system 14. (Page 7, Lines 24- 
28). In particular embodiments, system 12 may receive project documentation, work product, or 
other information fi-om client system 14 and store the information at resource database 16. (Page 
7, Lines 28-30). Such information may be used to obtain certification associated with one or 
more MLs of an SW-CMM, as described more fiilly below. (Page 7, Line 30, through Page 8, 
Line 1). A client system 14 may include one or more computer systems associated with an 
organization that may provide one or more users access to server system 12. (Page 8, Lines 1-3). 
The computer systems of client system 14 may be distributed throughout the organization and 
may, in particular embodiments, be geographically separated fi-om each other. (Page 8, Lines 3- 
5). 
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Resource database 16 may include one or more database systems that may collectively 
contain one or more resource sets 18. (Page 8, Lines 6-7). In particular embodiments, the 
database systems of resource database 16 may be geographically separated from each other. 
(Page 8, Lines 7-9). A resource set 18 in resource database 16 may include one or more 
resources that may be used to facilitate software engineering and management in connection with 
a software development project according to a process that is compliant with a qualitatively 
measurable standard. (Page 8, Lines 9-12). As an example and not by way of limitation, a 
resource set 18 may include information specifying one or more tasks that an organization may 
execute to reach one or more particular MLs of SEI's SW-CMM, as described more fully below. 
(Page 8, Lines 12-15). In particular embodiments, a resource set 18 may include an OSSP that 
facilitates compliance with one or more MLs of a CMM. (Page 8, Lines 15-16). In particular 
embodiments, resource set 18 may include one or more tools for tailoring an OSSP to a 
particular software project to generate a PDSP for the particular software project, as described 
more fully below. (Page 8, Lines 16-19). 

FIGURE 2 illustrates an example derivation of tasks from an example ML 22. (Page 8, 
Line 20). In particular embodiments, ML 22 may include ML2, MLS, or other suitable ML of 
SEI's SW-CMM or CMMI (or both) or other CMM. (Page 8, Lines 21-22). As described above, 
ML 22 may include one or more KPAs 24 and each BCPA 24 may, in turn, include one or more 
KPs 26. (Page 8, Lines 22-24). For each KPA 24, tasks 20 that address KPs 26 of KPA 24 may 
be identified. (Page 8, Lines 24-25). A task 20 may include one or more subtasks, according to 
particular needs. (Page 8, Lines 25-26). Reference to a KP 26 may include one or more 
subpractices of KP 26, where appropriate. (Page 8, Lines 26-27). To identify one or more tasks 
20 that address a KP 26, one or more policies associated with KP 26 may be identified. (Page 8, 
Lines 27-28). In addition, one or more proofs, artifacts, or other resources for demonstrating 
compliance with a CMM may be identified. (Page 8, Lines 28-30). One or more tasks 20 that 
address KP 26 may be derived from these identified policies, proofs, and artifacts. (Page 8, 
Lines 30-31). In particular embodiments, tasks 20 may each relate to one or more of the 
following: tools, checklists, templates, procedures, tasks, methods, activities, processes, 
standards, and policies. (Page 8, Line 31, through Page 9, Line 2). In particular embodiments, 
tasks 20 may each correspond (and be traceable) to one or more particular KPAs 24. (Page 9, 
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Lines 2-4). In addition to tasks 20, task collaterals associated with tasks 20 may also be 
identified. (Page 9, Lines 4-5). Task collaterals may include implementation aids (such as task 
descriptions for compliance with ML 22, templates, checklists policy statements, training and 
presentation materials, software tools, sample work products, and other implementation aids) and 
other resources. (Page 9, Lines 5-8). In particular embodiments, for each identified task 
collateral, CMM, Institute of Electrical and Electronics Engineers (IEEE), and other standards 
and sources related to the task collateral may be reviewed, a task collateral format identification 
scheme may be defined, and one or more task collateral templates may be created. (Page 9, 
Lines 8-12). 
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In particular embodiments, to facilitate an organization's or a software project's 
compliance with multiple MLs 22, multiple MLs 22 may be combined with each other for 
purposes of identifying tasks 20. (Page 9, Lines 13-15). As an example and not by way of 
limitation, a total of three hundred fifteen tasks 20 may be identified for all KPAs 24 of ML2 of 
the SEI's SW-CMM and all KPAs 24 of ML3 of the SEI's SW-CMM. (Page 9, Lines 15-17). In 
particular embodiments, tasks 20 may be consolidated into a set of "supertasks" to reduce 
redundancies across tasks 20 and to streamline compliance with one or more MLs 22. (Page 9, 
Lines 17-20). As an example and not by way of limitation, three hundred fifteen tasks 20 for 
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ML2 and ML3 of SEI's SW-CMM may be consolidated into the following seven supertasks: (1) 
establishing an organizational-level SPI team; (2) identifying ML3 gaps; (3) establishing an 
engagement-level SPI implementation infrastructure; (4) developing a PDSP and plans; (5) 
carrying out the PDSP and plans; (6) requesting and obtaining support from a Public Services 
Consulting (PSC) Software Engineering Process Group (SEPG) as needed; and (7) requesting 
and taking an ML3 appraisal from the SPC SEPG. (Page 9, Lines 20-27). After an organization 
or software project team has carried out these supertasks, the PSC SEPG may provide monthly 
status reports on ML3 SPI efforts by the organization or software project team to a PSC 
Management Steering Group. (Page 9, Lines 27-30). In particular embodiments, resources 
associated with one or more of these supertasks may be contained in one or more resource sets 
18 in resource database 16, as described more fiiUy below. (Page 9, Line 30, through Page 10, 
Line 2). 

In particular embodiments, establishing an engagement-level SPI implementation 
infrastructure may include: establishing required groups for ML2 and ML3 and assigning 
responsibilities; creating and disseminating policies associated with ML2 and ML3; training 
software project team members on processes associated with ML2 and processes associated with 
ML3; providing required training; and providing required orientations. (Page 10, Lines 3-8). In 
particular embodiments, developing a PDSP and plans may include: identifying a software life 
cycle model; tailoring a PDSP for a particular software project from an OSSP; developing and 
managing estimates; developing plans for ML2 and ML3; managing and controlling the 
developed plans for ML2 and ML3; and distributing the developed plans for ML2 and ML3. 
(Page 10, Lines 8-12). In particular embodiments, performing a PDSP may include: performing 
one or more software engineering tasks; performing one or more software management tasks; 
performing one or more measurement and analysis tasks; and performing one or more 
verification tasks. (Page 10, Lines 12-16). 

In particular embodiments, tasks 20 associated with an ML 22 may constitute an OSSP 
that an organization may use to implement ML 22. (Page 10, Lines 17-18). In addition or as an 
alternative, software project teams in the organization may use the OSSP to generate PDSPs for 
particular software projects. (Page 10, Lines 18-20). The OSSP may include task descriptions, 
task collaterals, and other resources associated with tasks 20. (Page 10, Lines 20-21). In 
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particular embodiments, the OSSP may include tasks 20 derived from multiple MLs 22. (Page 
10, Lines 21-22). In these embodiments, a single OSSP that includes tasks 20 may be used to 
implement MLs 22, (Page 10, Lines 22-24). In addition or as an alternative, the OSSP may be 
used to generate PDSPs for particular software projects. (Page 10, Lines 24-25). In particular 
embodiments, an OSSP may include supertasks instead of tasks 20, which may reduce 
redundancies in the OSSP, as well as streamline the OSSP. (Page 10, Lines 25-27). As 
described more fully below, one or more resource sets 18 in resource database 16 may contain 
the OSSP (and associated task collaterals and other resources), which may be made available to 
one or more users at one or more client systems 14. (Page 10, Lines 27-30). 

FIGURE 3 illustrates an example web page 28 providing access to an example resource 
set 18 for compliance with ML2 and ML3 of the SEI's SW-CMM. (Page 11, Lines 1-2). 
Resource set 18 includes an OSSP and associated resources for compliance with ML2 and ML3 
of the SEI's SW-CMM. (Page 11, Lines 2-4). Web page 28 includes a first area 30a that 
provides a summary of resource set 18. (Page 11, Lines 4-5). Web page 28 also includes a 
second area 30b that contains links 32 to particular resources in resource set 18. (Page 11, Lines 
5-6). Web page 28 includes multiple levels of links 32. (Page 11, Lines 6-7). A first level 
includes links 32 to resources associated with the seven supertasks described above. (Page 11, 
Lines 7-8). With respect to certain supertasks, a second level of links 32 includes links 32 to 
resources associated with certain components of those supertasks. (Page 11, Lines 8-10). As an 
example, the third supertask described above — establishing an engagement-level SPI 
implementation infrastructure — includes five components: (1) establishing ML2- and ML3- 
required groups and assigning responsibilities; (2) creating and disseminating ML2 and ML3 
policies; (3) training team members on one or more SW-CMM processes; (4) providing required 
training; and (5) providing required orientation. (Page 11, Lines 10-15). Each of these 
components has a link 32 in web page 28 to one or more resources associated with the 
component. (Page 11, Lines 15-16). With respect to certain supertasks, a third level of links 32 
includes links 32 to particular elements of components of those supertasks. (Page 11, Lines 16- 
18). 
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FIG. 3C 



A user at a client system 14 may click on or otherwise select a link 32 in web page 28 to 
gain access to one or more resources associated with the supertask, component, or element 
designated in link 32. (Page 11, Lines 19-21). When the user selects link 32, server system 12 
may access the one or more resources and communicate the one or more resources to the user. 
(Page 11, Lines 21-23). As an example and not by way of limitation, server system 12 may 
conmiunicate the one or more resources to the user in one or more hyper text markup language 
(HTML) files. (Page 11, Lines 23-25). As described above, the communicated resources may 
include one or more of the following: descriptions of one or more tasks 20 (or subtasks) or 
supertasks (or components or elements of supertasks); one or more task collaterals; one or more 
templates; and one or more other suitable resources. (Page 11, Lines 25-28). In particular 
embodiments, the resources accessible through web page 28 may collectively facilitate 
implementation of an OSSP in an organization. (Page 11, Lines 28-30). In addition or as an 
alternative, these resources may facilitate the development and implementation of a PDSP for a 
particular software project of the organization. (Page 11, Line 30, through Page 12, Line 2). 

FIGURE 6 illustrates an example method for facilitating software engineering and 
management in connection with a software development project according to a process that is 
compliant with a qualitatively measurable standard. (Page 15, Lines 4-6). The method begins at 
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step 100 where a user at a client system 14 accesses server system 12. (Page 15, Lines 6-7). At 
step 102, the user selects a particular resource set 18 in resource database 16. (Page 15, Lines 7- 
8). In particular embodiments, server system may provide a menu of resource sets 18 to the user 
to enable the user to make this selection. (Page 15, Lines 8-10). At step 104, server system 12 
provides user with links 32 to particular resources in resource set 18 selected by the user. (Page 
15, Lines 10-11). At step 106, the user selects a particular link 32 to a particular resource in 
resource set 18. (Page 15, Lines 11-13). At step 108, server system 12 accesses the particular 
resource and communicates the particular resource to the user. (Page 15, Lines 13-14). At step 
1 10, the user uses the particular resource in connection with a software project to facilitate the 
software project's compliance with one or more MLs associated with resource set 18, at which 
point the method ends. (Page 15, Lines 14-16). One or more steps in the method illustrated in 
FIGURE 6 may be repeated over the course of the software project to facilitate compliance with 
those MLs with respect to certain aspects of the software project. (Page 15, Lines 17-19). 



For the convenience of the Board, Appellant provides the following mappings of the 
independent claims here on appeal. Appellant does not necessarily identify all portions of the 
Specification and Drawings relevant to the recited elements of the claims. Appellant provides 
the following mapping not to limit the scope of the claims, but to help the Board make a decision 
on this Appeal: 



Independent Claim 1 recites: 

A system facilitating software engineering and management in connection 
with a software development project according to a process that is compliant with 
a qualitatively measurable standard, comprising: 

a server system operable to conununicate with a plurality of client 
systems; (e.g.: Figure 1; Page 7, Line 18, through Page 8, Line 5) 

a database associated with the server system and containing resources 
accessible to the client systems using the server system in connection with one or 
more software development projects, the resources comprising at least: (e.g.: 
Figure 1; Page 8, Lines 6-19) 

first resources specifying a plurality of tasks to be performed 
within the process and specifying for each task one or more of: (e.g.: Figure 1; 
Page 7, Line 18, through Page 10, Line 2) 

a description of the task; (e.g.: Page 11, Line 19, through 
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Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

a description of how the task relates to the standard; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 

Line 4) 

one or more activities to be performed for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

which personnel should perform the activities for the task; 
(e.g.: Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 
14, Line 4) 

one or more deliverables to be generated for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more expected artifacts according to which the 
process will be measured against the standard; and (e.g.: Page 11, Line 19, 
through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

an expected time to complete the task; and (e.g.: Page 11, 
Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

second resources comprising one or more templates, each template 
operable to be customized in generating one or more deliverables for one or more 
tasks; (Figure 5; Page 8, Line 20, through Page 9, Line 12; Page 11, Line 19, 
through Page 12, Line 2; Page 14, Line 27, through Page 15, Line 3) 

the server system operable to, at one or more times during a software 
development project: (Figure 6; Page 15, Lines 4-19) 

receive from a user associated with a client system a request for 
one or more resources; (Figure 6; Page 15, Lines 4-19) 

retrieve the requested resources from the database; and (Figure 6; 
Page 15, Lines 4-19) 

provide the requested resources to the user in connection with the 
software development project. (Figure 6; Page 15, Lines 4-19) 



Independent Claim 7 recites: 

A method facilitating software engineering and management in connection 
with a software development project according to a process that is compliant with 
a qualitatively measurable standard, comprising: 

providing a plurality of client systems with access to a database associated 
with a server system in connection with one or more software development 
projects, the database containing resources comprising at least: (e.g.: Figure 1; 
Page 7, Line 18, through Page 8, Line 19) 

first resources specifying a plurality of tasks to be performed 
within the process and specifying for each task one or more of: (e.g.: Figure 1; 
Page 7, Line 18, through Page 10, Line 2) 

a description of the task; (e.g.: Page 11, Line 19, through 
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Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

a description of how the task relates to the standard; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more activities to be performed for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

which personnel should perform the activities for the task; 
(e.g.: Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 
14, Line 4) 

one or more deliverables to be generated for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more expected artifacts according to which the 
process will be measured against the standard; and (e.g.: Page 11, Line 19, 
through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

an expected time to complete the task; and (e.g.: Page 11, 
Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

second resources comprising one or more templates, each template 
operable to be customized in generating one or more deliverables for one or more 
tasks; (Figure 5; Page 8, Line 20, through Page 9, Line 12; Page 11, Line 19, 
through Page 12, Line 2; Page 14, Line 27, through Page 15, Line 3) 

at one or more times during a software development project: (Figure 6; 
Page 15, Lines 4-19) 

receiving from a user associated with a client system a request for 
one or more resources; (Figure 6; Page 15, Lines 4-19) 

retrieving the requested resources from the database; and (Figure 
6; Page 15, Lines 4-19) 

providing the requested resources to the user in connection with 
the software development project. (Figure 6; Page 15, Lines 4-19) 



Independent Claim 13 recites: 

Software facilitating software engineering and management in connection 
with a software development project according to a process that is compliant with 
a qualitatively measurable standard, the software being embodied in computer 
readable media and when executed operable to: 

provide a plurality of client systems with access to a database associated 
with a server system in connection with one or more software development 
projects, the database containing resources comprising at least: (e.g.: Figure 1; 
Page 7, Line 18, through Page 8, Line 19) 

first resources specifying a plurality of tasks to be performed 
within the process and specifying for each task one or more of: (e.g.: Figure 1; 
Page 7, Line 1 8, through Page 10, Line 2) 
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a description of the task; (e.g.: Page 11, Line 19, through 
Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

a description of how the task relates to the standard; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more activities to be performed for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

which personnel should perform the activities for the task; 
(e.g.: Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 

14, Line 4) 

one or more deliverables to be generated for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more expected artifacts according to which the 
process will be measured against the standard; and (e.g.: Page 11, Line 19, 
through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

an expected time to complete the task; and (e.g.: Page 11, 
Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

second resources comprising one or more templates, each template 
operable to be customized in generating one or more deliverables for one or more 
tasks; (Figure 5; Page 8, Line 20, through Page 9, Line 12; Page 11, Line 19, 
through Page 12, Line 2; Page 14, Line 27, through Page 15, Line 3) 

at one or more times during a software development project: (Figure 6; 
Page 15, Lines 4-19) 

receive from a user associated with a client system a request for 
one or more resources; (Figure 6; Page 15, Lines 4-19) 

retrieve the requested resources from the database; and (Figure 6; 
Page 15, Lines 4-19) 

provide the requested resources to the user in connection with the 
software development project. (Figure 6; Page 15, Lines 4-19) 



Independent Claim 19 recites: 

A system facilitating software engineering and management in connection 
with a software development project according to a process that is compliant with 
a qualitatively measurable standard, comprising: 

means for providing a plurality of client systems with access to a database 
associated with a server system in connection with one or more software 
development projects, the database containing resovirces comprising at least: (e.g.: 
Resource Database 16; Figure 1; Page 7, Line 18, through Page 8, Line 19) 

first resources specifying a plurality of tasks to be performed 
within the process and specifying for each task one or more of: (e.g.: Figure 1; 
Page 7, Line 18, through Page 10, Line 2) 
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a description of the task; (e.g.: Page 11, Line 19, through 
Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

a description of how the task relates to the standard; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more activities to be performed for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

which personnel should perform the activities for the task; 
(e.g.: Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 

14, Line 4) 

one or more deliverables to be generated for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more expected artifacts according to which the 
process will be measured against the standard; and (e.g.: Page 11, Line 19, 
through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

an expected time to complete the task; and (e.g.: Page 11, 
Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

second resources comprising one or more templates, each template 
operable to be customized in generating one or more deliverables for one or more 
tasks; (Figure 5; Page 8, Line 20, through Page 9, Line 12; Page 11, Line 19, 
through Page 12, Line 2; Page 14, Line 27, through Page 15, Line 3) 

means for, at one or more times during a software development project: 
(Server System 12; Figure 6; Page 15, Lines 4-19) 

receiving from a user associated with a client system a request for 
one or more resources; (Figure 6; Page 15, Lines 4-19) 

retrieving the requested resources from the database; and (Figure 
6; Page 15, Lines 4-19) 

providing the requested resources to the user in connection with 
the software development project. (Figure 6; Page 15, Lines 4-19) 



Independent Claim 20 recites: 

A system facilitating software engineering and management in connection 
with a software development project according to a process that is compliant with 
the Software Engineering Institute's Software Capability Maturity Model 
(SEI/SW-CMM), the SEI/SW-CMM comprising one or more maturity levels, 
each maturity level comprising a plurality of key practice areas, each key practice 
area comprising a plurality of goals, each goal comprising a plurality of key 
practices, the system comprising: (e.g.: Figure 2; Page 8, Line 20, through Page 9, 
Line 12) 

a server system operable to communicate with a plurality of client 
systems; (e.g.: Figure 1; Page 7, Line 18, through Page 8, Line 5) 
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a database associated with the server system and containing resources 
accessible to the client systems using the server system in connection with one or 
more software development projects, the resources comprising at least: (e.g.: 
Figure 1 ; Page 8, Lines 6-19) 

first resources specifying a plurality of tasks to be performed 
within the process and specifying for each task one or more of: (e.g.: Figure 1; 
Page 7, Line 18, through Page 10, Line 2) 

a description of the task; (e.g.: Page 11, Line 19, through 
Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

an identification of one or more SEI/SW-CMM maturity 
levels, key practice areas, goals, and key practices to which the task relates; (e.g.: 
Page 8, Line 20, through Page 9, Line 12; Page 11, Line 19, through Page 12, 
Line 2; Page 12, Line 25, through Page 14, Line 4) 

one or more activities to be performed for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

which personnel should perform the activities for the task; 
(e.g.: Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 
14, Line 4) 

one or more deliverables to be generated for the task; (e.g.: 
Page 11, Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, 
Line 4) 

one or more expected artifacts according to which the 
process will be measured against the SEI/SW-CMM; and (e.g.: Page 11, Line 19, 
through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

an expected time to complete the task; and (e.g.: Page 11, 
Line 19, through Page 12, Line 2; Page 12, Line 25, through Page 14, Line 4) 

second resources comprising one or more templates, each template 
operable to be customized in generating one or more deliverables for one or more 
tasks, each template comprising one of: (Figure 5; Page 8, Line 20, through Page 
9, Line 12; Page 11, Line 19, through Page 12, Line 2; Page 14, Line 27, through 
Page 15, Line 3) 

a standard template generic to a plurality of software 
development projects within an enterprise; and (Figure 5; Page 8, Line 20, 
through Page 9, Line 12; Page 11, Line 19, through Page 12, Line 2; Page 14, 
Line 27, through Page 15, Line 3) 

at least a portion of a deliverable generated in connection 
with a previous software development project; (Figure 5; Page 8, Line 20, through 
Page 9, Line 12; Page 11, Line 19, through Page 12, Line 2; Page 14, Line 27, 
through Page 15, Line 3) 

the server system operable to, at one or more times during a software 
development project: (Figure 6; Page 15, Lines 4-19) 

receive from a user associated with a client system a request for 
one or more resources; (Figure 6; Page 15, Lines 4-19) 
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retrieve the requested resources from the database; and (Figure 6; 
Page 15, Lines 4-19) 

provide the requested resources to the user in connection with the 
software development project; (Figure 6; Page 15, Lines 4-19) 

the server system ftirther operable to, at one or more times during a 
software development project: (Figure 1; Page 7, Line 18, through Page 8, Line 5) 

receive a deliverable generated in connection with the software 
development project; (Figure 1; Page 7, Line 18, through Page 8, Line 5) 

store at least a portion of the deliverable in the database; 
and(Figure 1; Page 7, Line 18, through Page 8, Line 5) 

make the stored portion of the deliverable accessible to the client 
systems for use, with or without customization, in connection with subsequent 
software development projects. (Figure 1; Page 7, Line 18, through Page 8, Line 
5) 
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Grounds of Rejection for Review on Appeal 

Appellant requests the Board to review the Examiner's final rejection of Claims 1-20 
under 35 U.S.C. § 102(e) as being anticipated by U.S. Patent Application Publication No. 
2006/0235732 by Miller et al. ("M7/er"). The attached Evidence Appendix includes a copy of 
Miller. 



DALO 1:995911.1 



ATTORNEY DOCKET: 
068215.0120 



23 



PATENT APPLICATION 
10/696,817 



Argument 

For at least the following reasons, the Examiner's final rejection of Claims 1-20 is 
improper and the Board should reverse the Examiner's rejection. 

Independent Claims 1, 7, 13, and 19-20 are Allowable Over Miller 

The Examiner rejects independent Claims 1, 7, 13 and 19-20 under 35 U.S.C. § 102(e) as 
being anticipated by U.S. Patent Application Publication No. 2006/0235732 by Miller et al. 
CMiller"). Miller merely discloses a database containing information on an organization and its 
suppliers and a multiple repository system containing stored templates that users can access to 
compose documents through the stored templates. (Figures IIA-IIB and 14; Paragraph 0280 
and 0310-0311). 

In contrast, independent Claim 1 of this Application recites: 

A system facilitating software engineering and management in connection 

with a software development project according to a process that is compliant with 

a qualitatively measurable standard, comprising: 

a server system operable to communicate with a plurality of client 

systems; 

a database associated with the server system and containing resources 
accessible to the client systems using the server system in connection with one or 
more software development projects, the resources comprising at least: 

first resources specifying a plurality of tasks to be performed 
within the process and specifying for each task one or more of: 
a description of the task; 

a description of how the task relates to the standard; 

one or more activities to be performed for the task; 

which personnel should perform the activities for the task; 

one or more deliverables to be generated for the task; 

one or more expected artifacts according to which the 
process will be measured against the standard; and 

an expected time to complete the task; and 
second resources comprising one or more templates, each template 
operable to be customized in generating one or more deliverables for one or more 
tasks; 

the server system operable to, at one or more times during a software 
development project: 
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receive from a user associated with a client system a request for 

one or more resources; 

retrieve the requested resources from the database; and 

provide the requested resources to the user in connection with the 

software development project. 

Independent Claims 7, 13, and 19-20 recite similar limitations. 

To reject independent Claim 1, the Examiner asserts either the database containing 
information on an organization and its suppliers or the multiple repository system in Miller can 
properly be considered a database associated with the server system and containing resources 
accessible to the client systems using the server system in connection with one or more 
software development projects, as independent Claim 1 recites. Appellant disagrees with the 
Examiner. 

Even assimiing for the sake or argument the database in Miller containing information on 
an organization and its suppliers or the multiple repository system in Miller could properly be 
considered a database associated with the server system and containing resources accessible to 
the client systems using the server system in connection with one or more software 
development projects. Miller would still fail to disclose, teach, or suggest that the database in 
Miller, the multiple repository system in Miller, or a combination of the two contains, as 
independent Claim 1 specifically recites, first resources specifying a plurality of tasks to be 
performed within the process and specifying for each task one or more of: 

• a description of the task; 

• a description of how the task relates to the standard; 
. one or more activities to be performed for the task; 

. which personnel should perform the activities for the task; 

• one or more deliverables to be generated for the task; 

. one or more expected artifacts according to which the process will be measured 
against the standard; and 

• an expected time to complete the task. 
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The database in Miller merely contains information on an organization and its suppliers. 
Moreover, the multiple repository system in Miller merely contains stored templates users can 
access to compose documents through the stored templates. (Figures llA-ll-B and 14; 
Paragraph 0280 and 0310-031 1). Nowhere does Miller disclose, teach, or suggest that either or 
both contain each and every one of the first resources that independent Claim 1 specifically 
recites. 

In the Office Action sent 13 September 2007, the Examiner identifies various steps of a 
Software Engineering Process Group (SEPG) project execution process in Miller and asserts 
these steps are contents of the multiple repository system in Miller that can properly be 
considered first resources. Appellant again disagrees with the Examiner. Even assuming for the 
sake of argument these steps in Miller could properly be considered as specifying for each 
task — which is not at all clear— M/Z/er would still fail to disclose, teach, or suggest that the 
multiple repository system in Miller contains any of those steps. 

In the Advisory Action sent 13 December 2007, the Examiner asserts the multiple 
repository accelerated process improvement framework (APIF) system in Miller can properly be 
considered a database associated with the server system and containing resources accessible to 
the client systems using the server system in connection with one or more software 
development projects. Appellant again disagrees with the Examiner. As the Examiner points 
out, the APIF system in Miller distributes documents needed for a CMM method, including 
instructions for implementing the CMM method and documentation to evidence actions taken in 
the CMM method. Even so. Miller still fails to disclose, teach, or suggest that these instructions 
and documentation can properly be considered each and every one of the first resources that 
independent Claim 1 specifically recites. 

"To anticipate, every element and limitation of the claimed invention must be found in a 
single prior art reference, arranged as in the claim." Brown v. 3M, 265 F.3d 1349, 1351 (Fed. 
Cir. 2001). "A claim is anticipated only if each and every element as set forth in the claim is 
found, either expressly or inherently described, in a single prior art reference." Verdegaal Bros. 
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V. Union Oil Co. of California, 814 F.2d 628, 631, 2 U.S.P.Q.2d 1051, 1053 (Fed. Cir. 1987); 
M.P.E.P. ch. 2131 (Rev. 3, Aug. 2005) (quoting Verdegaal, 814 F.2d at 631). Moreover, "[t]he 
identical invention must be shown in as complete detail as is contained in the patent claim." 
Richardson v. Suzuki Motor Co., 868 F.2d 1226, 1236, 9 U.S.P.Q.2d 1913, 1920 (Fed. Cir. 

1989) ; M.P.E.P. ch. 2131 (Rev. 3, Aug. 2005) (quoting Richardson, 868 F.2d at 1236). 
Furthermore, "[t]he elements must be arranged as required by the claim." M.P.E.P. ch. 2131 
(Rev. 3, Aug. 2005) (citing In re Bond, 910 F.2d 831, 832, 15 U.S.P.Q.2d 1566, 1567 (Fed. Cir. 

1990) ). As shown above. Miller fails to disclose, either expressly or inherently, each and every 
limitation of independent Claim 1. Therefore, Miller does not anticipate independent Claim 1 
under governing Federal Circuit case law and the M.P.E.P. 

For at least the reasons above, independent Claims 1, 7, 13, and 19-20 are allowable over 
the cited references. Accordingly, the Board should reverse the final rejection of independent 
Claims 1,7, 13, and 19-20 and all their dependent claims and instruct the Examiner to issue a 
notice of allowance of the same. 
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Conclusion 



Appellant has demonstrated that the pending claims are clearly allowable. Appellant 
respectfully requests the Board of Patent Appeals and Interferences to reverse the Examiner's 
final rejection of the pending claims and instruct the Examiner to issue a notice of allowance of 
the same. 

Please charge $510.00 for this Appeal Brief and $460.00 for a two-month extension of 
time to Deposit Account No. 02-0384 of BAKER BOTTS L.L.P. The Commissioner is 
authorized to charge any fee and credit any overpayment to Deposit Account No. 02-0384 of 
BAKER BOTTS L.L.P. 



Respectfully submitted, 



BAKER BOTTS L.L.P. 



Attorneys for Appellant 




Travis W. Thomas 
Reg. No. 48,667 



Date: 17 April 2008 



Correspondence Address: 



Customer Number 05073 
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Claims Appendix 

1. (Original) A system facilitating software engineering and management in 
connection with a software development project according to a process that is compliant with a 
qualitatively measurable standard, comprising: 

a server system operable to communicate with a plxjrality of client systems; 

a database associated with the server system and containing resources accessible to the 
client systems using the server system in connection with one or more software development 
projects, the resources comprising at least: 

first resources specifying a plurality of tasks to be performed within the process 
and specifying for each task one or more of: 

a description of the task; 

a description of how the task relates to the standard; 

one or more activities to be performed for the task; 

which personnel should perform the activities for the task; 

one or more deliverables to be generated for the task; 

one or more expected artifacts according to which the process will be 
measured against the standard; and 

an expected time to complete the task; and 
second resources comprising one or more templates, each template operable to be 
customized in generating one or more deliverables for one or more tasks; 

the server system operable to, at one or more times during a software development 
project: 

receive from a user associated with a client system a request for one or more 

resources; 

retrieve the requested resources from the database; and 

provide the requested resources to the user in connection with the software 
development project. 
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2. (Original) The system of Claim 1, wherein the standard comprises one or 
more maturity levels, each maturity level comprising a plurality of key practice areas, each key 
practice area comprising a plurality of goals, each goal comprising a plurality of key practices. 

3. (Original) The system of Claim 2, wherein the standard comprises the 
Software Engineering Institute's Software Capability Maturity Model (SEI/SW-CMM). 

4. (Original) The system of Claim 2, wherein the description of how the task 
relates to the standard comprises an identification of one or more maturity levels, key practice 
areas, goals, and key practices to which the task relates. 

5 . (Original) The system of Claim 1 , wherein each template comprises one of: 

a standard template generic to a plurality of software development projects within an 
enterprise; and 

a deliverable generated in connection with a previous software development project. 

6. (Original) The system of Claim 1, wherein the server system is fiirther 
operable to, at one or more times during a software development project: 

receive a deliverable generated in connection with the software development project; 
store at least a portion of the deliverable in the database; and 

make the stored portion of the deliverable accessible to the client systems for use, with or 
without customization, in connection with subsequent software development projects. 
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7. (Original) A method facilitating software engineering and management in 
connection with a software development project according to a process that is compliant with a 
qualitatively measurable standard, comprising: 

providing a plurality of client systems with access to a database associated with a server 
system in connection with one or more software development projects, the database containing 
resources comprising at least: 

first resources specifying a plurality of tasks to be performed within the process 
and specifying for each task one or more of: 

a description of the task; 

a description of how the task relates to the standard; 
one or more activities to be performed for the task; 
which personnel should perform the activities for the task; 
one or more deliverables to be generated for the task; 
one or more expected artifacts according to which the process will be 
measured against the standard; and 

an expected time to complete the task; and 
second resources comprising one or more templates, each template operable to be 
customized in generating one or more deliverables for one or more tasks; 
at one or more times during a software development project: 

receiving from a user associated with a client system a request for one or more 

resources; 

retrieving the requested resources from the database; and 

providing the requested resources to the user in connection with the software 
development project. 

8. (Original) The method of Claim 7, wherein the standard comprises one or 
more maturity levels, each maturity level comprising a plurality of key practice areas, each key 
practice area comprising a plurality of goals, each goal comprising a plurality of key practices. 
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9. (Original) The method of Claim 8, wherein the standard comprises the 
Software Engineering Institute's Software Capability Maturity Model (SEI/SW-CMM). 

10. (Original) The method of Claim 8, wherein the description of how the task 
relates to the standard comprises an identification of one or more maturity levels, key practice 
areas, goals, and key practices to which the task relates. 

1 1 . (Original) The method of Claim 7, wherein each template comprises one of: 

a standard template generic to a plurality of software development projects within an 
enterprise; and 

a deliverable generated in cormection with a previous software development project. 

12. (Original) The method of Claim 7, ftirther comprising, at one or more times 
during a software development project: 

receiving a deliverable generated in connection with the software development project; 
storing at least a portion of the deliverable in the database; and 

making the stored portion of the deliverable accessible to the client systems for use, with 
or without customization, in cormection with subsequent software development projects. 
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13. (Original) Software facilitating software engineering and management in 
connection with a software development project according to a process that is compliant with a 
qualitatively measurable standard, the software being embodied in computer readable media and 
when executed operable to: 

provide a plurality of client systems with access to a database associated with a server 
system in connection with one or more software development projects, the database containing 
resources comprising at least: 

first resources specifying a plurality of tasks to be performed within the process 
and specifying for each task one or more of: 

a description of the task; 

a description of how the task relates to the standard; 
one or more activities to be performed for the task; 
which personnel should perform the activities for the task; 
one or more deliverables to be generated for the task; 
one or more expected artifacts according to which the process will be 
measured against the standard; and 

an expected time to complete the task; and 
second resources comprising one or more templates, each template operable to be 
customized in generating one or more deliverables for one or more tasks; 
at one or more times during a software development project: 

receive from a user associated with a client system a request for one or more 

resources; 

retrieve the requested resources from the database; and 

provide the requested resources to the user in connection with the software 
development project. 

14. (Original) The software of Claim 13, wherein the standard comprises one or 
more maturity levels, each maturity level comprising a plurality of key practice areas, each key 
practice area comprising a plurality of goals, each goal comprising a plurality of key practices. 
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15. (Original) The software of Claim 14, wherein the standard comprises the 
Software Engineering Institute's Software Capability Maturity Model (SEI/SW-CMM). 

1 6. (Original) The software of Claim 1 4, wherein the description of how the task 
relates to the standard comprises an identification of one or more maturity levels, key practice 
areas, goals, and key practices to which the task relates. 

17. (Original) The software of Claim 13, wherein each template comprises one 

of: 

a standard template generic to a plurality of software development projects within an 
enterprise; and 

a deliverable generated in connection with a previous software development project, 

1 8 . (Original) The software of Claim 1 3 , fiirther operable to, at one or more times 
during a software development project: 

receive a deliverable generated in connection with the software development project; 
store at least a portion of the deliverable in the database; and 

make the stored portion of the deliverable accessible to the client systems for use, with or 
without customization, in connection with subsequent software development projects. 
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19. (Original) A system facilitating software engineering and management in 
connection with a software development project according to a process that is compliant with a 
qualitatively measurable standard, comprising: 

means for providing a plurality of client systems with access to a database associated 
with a server system in connection with one or more software development projects, the database 
containing resources comprising at least: 

first resources specifying a plurality of tasks to be performed within the process 
and specifying for each task one or more of: 

a description of the task; 

a description of how the task relates to the standard; 
one or more activities to be performed for the task; 
which personnel should perform the activities for the task; 
one or more deliverables to be generated for the task; 
one or more expected artifacts according to which the process will be 
measured against the standard; and 

an expected time to complete the task; and 
second resources comprising one or more templates, each template operable to be 
customized in generating one or more deliverables for one or more tasks; 

means for, at one or more times during a software development project: 

receiving from a user associated with a client system a request for one or more 

resources; 

retrieving the requested resources from the database; and 

providing the requested resources to the user in connection with the software 
development project. 
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20. (Original) A system facilitating software engineering and management in 
connection with a software development project according to a process that is compliant with the 
Software Engineering Institute's Software Capability Maturity Model (SEI/SW-CMM), the 
SEI/SW-CMM comprising one or more maturity levels, each maturity level comprising a 
plurality of key practice areas, each key practice area comprising a plurality of goals, each goal 
comprising a plurality of key practices, the system comprising: 

a server system operable to commimicate with a plurality of client systems; 

a database associated with the server system and containing resources accessible to the 
client systems using the server system in connection with one or more software development 
projects, the resources comprising at least: 

first resources specifying a plurality of tasks to be performed within the process 
and specifying for each task one or more of: 

a description of the task; 

an identification of one or more SEI/SW-CMM maturity levels, key 
practice areas, goals, and key practices to which the task relates; 

one or more activities to be performed for the task; 

which personnel should perform the activities for the task; 

one or more deliverables to be generated for the task; 

one or more expected artifacts according to which the process will be 
measured against the SEI/SW-CMM; and 

an expected time to complete the task; and 
second resources comprising one or more templates, each template operable to be 
customized in generating one or more deliverables for one or more tasks, each template 
comprising one of: 

a standard template generic to a plurality of software development projects 
within an enterprise; and 

at least a portion of a deliverable generated in connection with a previous 
software development project; 

the server system operable to, at one or more times during a software development 

project: 
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receive from a user associated with a client system a request for one or more 

resources; 

retrieve the requested resources from the database; and 

provide the requested resources to the user in connection with the software 
development project. 

the server system further operable to, at one or more times during a software 
development project: 

receive a deliverable generated in connection with the software development 

project; 

store at least a portion of the deliverable in the database; and 
make the stored portion of the deliverable accessible to the client systems for use, 
with or without customization, in connection with subsequent software development projects. 
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(57) ABSTRACT 

The present invention relates to a method and related system 
for assisting and expediting an organization production of a 
more mature product. The method and system may include 
implementation of processes using a combination of both 
electronic hardware and software and implementation 
locally or over a network such as an intranet or the Internet. 
In another embodiment, the method may be implemented 
using a document management system to administer files 
related to the steps in the method. These files may assist a 
user in the creation of required documentation. A document 
management tool may be integrated with the document 
management system to associate documentation with steps 
in the method. A navigator tool may be employed to create 
a graphical display of the steps in the method using data 
contained in the files. Another embodiment of the present 
invention uses WebDAV-based communication to coordi- 
nate access to multiple dociunent repositories. 
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ACCELERATED PROCESS IMPROVEMENT 
FRAMEWORK 

RELATED APPLICATIONS 

[0001] This application is a continuation-in-part of U.S. 
application Ser. No. 10/005,759, filed on Dec. 7, 2001, the 
contents of which are hereby incorporated by reference in 
their entirety. The application fijrther claims priority from 
U.S. Provisional Application No. 60/399,459 filed on Jul. 
31, 2002, tlie contents of which are also incorporated by 
reference in their entirety. 

FIELD OF THE INVENTION 

[0002] The present invention relates to a method for 
assisting and expediting an organization's progression 
through the levels of the Capability Maturity Model (CMM). 
Specifically, the present invention relates to a method and 
related system for arranging and administering an oigani- 
zation's infrastructure and a project of interest so that the 
organization and tlie product may be more mature, as 
measured by the CMM. 

BACKGROUND OF THE INVENTION 

[0003] The Capability Maturity Model® (CMM(Si) may 
refer specifically to the Capability Maturity Model for 
Software (SW-CMM) or, more generally, to a number of 
other process improvement models developed by the Soft- 
ware Engineering Institute (SEI) and registered to Camegie 
Mellon University. The SW-CMM was the first model 
developed by the SEI, and it originally evolved from the 
need for the United States Department of Defense to have 
another measure besides "lowest bidder" in determining 
who should win project bids. Specifically, the Department of 
Defense desired a method to better compare and distinguish 
well designed and shoddy, defective products. Tlie two 
major usages of the SW-CMM arc; (1) as a model for 
Software Process Improvement (SPI) and (2) as a measure 
of the capability to produce quality systems. Specifically, the 
CMM may help a purchaser differentiate properly working 
product from an incomplete, nonfiuictioning, poorly 
designed product by providing information on a producing 
organization and its production and development proce- 

[0004] The CMM is an example of a model-based 
improvement approach that focuses on creation process 
quality. Tlie rationale for this focus is that, unlike hardware, 
manufacRiring software is essentially error free (i.e., the 
production of the disks containing the program), but the 
quality defects (i.e., bugs) are produced during the concept 
and development process. Therefore, waiting to identify 
defects after creation of the product is generally difficult and 
costly. The CMM may be used as a guideline for prioritizing 
limited resources on the most important, foundational 
improvements. In the SW-CMM, Key Process ,\reas (KRAs) 
define "building blocks" based on industry best practices. 
The ultimate goal is to establish "continual improvement" of 
the software engineering process and the resuhing products, 
kaizen (Statistical Process Control), which is common in 
nonsottware engineering disciplines. Tlie CMM is described 
more flilly in Mark C. Paulk, The Capability Maturity 
Model: Guidelines for Improving the Software Process (The 
SEI Series) (.A.ddison- Wesley Pub Co,) (1995). 



[OOOS] The Capability Maturity Model Integration^'^ 
(CMM^") was developed to integrate the SW-CMM and 
various other existing models into a common model. The 
developers of the CMMI are seeking to establish common 
terminology between the models, as well as identifying 
commonality and variability. The SEI is expected to release 
Version 1.1 of CMMI in the near ftmire. 
[0006] Tlie SW-CMM model defines five capability levels 
and identifies Key Process Areas (KPAs). The CMMI model 
replaces the KR4s with Process Areas (PAs). The lower 
levels of the CMMI and the related PAs focus mainly on 
management processes and industry minimal standards. 
Higher CMMI levels and the related PAs generally focus 
more on organizational and technical processes. Hie liiglier 
levels and their PAs also strive for "industry-best" practice. 

[0007] While the entire scope of the CMMI is vast and 
generally outside the range of tliis document, tlie various 
levels of the CMMI are now quickly described. At level 0 or 
"Incomplete", a project has not yet started. Upon uiitiation 
and existence of the project, the project is at level 1. At 
"Initial" or level 1, tlie product conditions are ad hoc, 
chaotic, and high-risk. At "Repeatable" or level 2, the 
project may repeatedly perform some fiinctions with diffi- 
culty. Relevant PAs to level 2 are Requirements Manage- 
ment (RM); Project Plamiing (PP); Project Monitoring and 
Control (PMC or PC); Supplier .Agreement Management 
(S.AM or SM); Process and Product Quality Assurance 
(PPQA or QA); Configuration Management (CM); and 
Measurement and Analysis (MA). 

[0008] At "Organizationally Defined" or level 3, the rel- 
evant R\s include Requirements Development (RD); Tech- 
nical Solution (TS); Product Integration (PI); Validation 
(Va); Verification (Ve); Organization Process Focus (OPF or 
PF); Organizational Process Definition (OPD or PD); Orga- 
nizational Training (OT); Integrated Prciject Management 
(1PM or IM); Risk Management (RSKM or Rk); Decision 
Analysis and Resolution (DAR or DA); Organizational 
Enviromnent for Integration (QI); and Integrated Teaming 
(IT). 

[0009] .At "Quantitatively Managed" or level 4, the rel- 
evant PAs are Quantitative Process Management (QPM or 
QM) and Organizational Process Performance (OPP or OP). 
QPM relates to the informed and correct use of rigorous 
statistical techniques such as statistical process control 
(SPC), with the focus on removing specific or attributable 
causes of variance, and OPP relates to the use of statistical 
tecliniques to measure process efficiency. The fifth and 
higliest level, "Optimizing", is basically equivalent to bot- 
tom-up process improvement or continuous improvement. 
In CMMI, the level 5 PAs are Organizational Imiovation and 
Deployment (OID or ID) and Causal Analysis and Resolu- 
tion (CAR or CA). 

[0010] The Capability Maturity Model for Software (SW- 
CMM) was the first, but not the only, model for improve- 
ment of software development. Some other models devel- 
oped by the SEI include: Integrated Product Development 
CMM (IPD-CMM), which was renamed and incorporated 
into CMMI Integrated Product and Process Development 
(IPPD); People CMM (P-CMM) for Training, Career Devel- 
opment, and Human Resource-related issues; Personal Soft- 
ware Process^" (PSP^"); Softw<are Acquisition CMM® 
(SA-CMM); and Systems Engineering CMM® (SE-CMM), 
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which is being incorporated into CMMI for Systems Engi- 
neering/Software Engineering. Similarly, FAA-iCMM (a 
model similar to CMMI and incorporating elements of 
SW-CMM, SE-CMM, and SA-CMM) was developed by the 
Federal Aviation Administration. 

[0011] Achieving higlier levels of CMM maturity is a 
desirable goal in itself because it generally implies that an 
organization is producing a superior product and services 
since the higlier levels of tlie CMM generally require tlie 
existence of infrastructure and procedures leading to better 
tested and developed software and other products. As sug- 
gested above, organizations also have secondary financial 
incentives to achieve higlier CMM levels, because custom- 
ers, such as the United States Department of Defense, are 
increasingly requiring software suppliers to have a suiE- 
ciently high CMM level (e.g., at least level 2) before being 
awarded a contract. 

[0012] A threshold problem for many organizations is that 
the requirements for the diflferent maturity levels are rela- 
tively complex to understand and implement. It is, therefore, 
a goal of the present invention to provide a method allowing 
businesses to achieve higher CMM levels witliout having to 
understand the complicated requirements of each level. 
[0013] Furthermore, the process of achieving lugher 
CMM levels of increased maturity is typically a difficult, 
expensive, and time-intensive process. While some of the 
costs arc unavoidable, many of the difRcuities of achieving 
higher CIVIM levels occur because the requirements for the 
levels do not fit well within the general operations and 
stnictiire of most organizations. Drastically changing an 
organization's structure and operations is generally a com- 
plex and difficult process. Tlierefore, another goal of the 
present invention is to provide a method that sunplifies and 
potentially accelerates the process of modifying an organi- 
zation's operations and stmcture to meet the requirements of 
the higher CMM levels. 

[0014] Similariy many organizations also have difficulty 
implementing changes to achieve higlier CMM or CMMI 
levels because the organization use of these maturity models 
as merely checklists of criteria. The maturity models, while 
serving as a measure to assess organizations, offer little 
guidance to organizations on implementation of die speci- 
fied criteria. The random implementation of the items on a 
maturity model checklist results in increased time and cost 
for mamration in comparison to carrying out systemic 
changes that may concurrently satisfy multiple checklist 
items and assist the organization in achieving several check- 
list items. Furthermore, a piecemeal implementation of the 
CMM worsens the above-described problems of complexity 
and cost. It is, therefore, another goal of tlie present inven- 
tion to provide a method by wliich organizations may 
implement systemic changes to achieve higher levels of 
CMM maturity. 

SUMMARY OF THE INVENTION 

[0015] In response to these and other needs, the present 
invention provides a metliod and related system for assisting 
and expediting an organization's transfonnation toward 
higher levels of the Capability Maturity Model (CMM) or 
otlier derivative maturity models. In particular, the present 
invention provides a method for producing a more mature 
product. A preferred embodiment of the method comprises 



the managing an organization developing the product, 
whereby the organizational management comprises manag- 
ing personnel of the organization and implementing a prod- 
uct improvement process. The method may fiirther comprise 
managing a project for developing the product and manag- 
ing the delivery of the product. Furthermore, actions under- 
taken during the organizational management affects imple- 
mentation of the project and delivery managements, and the 
actions imdertaken during the project and delivery manage- 
ments likewise affect implementation of the oigam2ational 

[0016] In another embodiment, this method may be imple- 
mented using a combination of both electronic hardware and 
software and may be unplemented locally or over a network 
such as an intranet or the Internet. In another embodiment, 
the method may be implemented using a document man- 
agement system to administer files related to the steps in the 
method. Tliese files may assist a user in die creation of 
required documentation. A docimient management tool may 
be integrated with the document management system to 
associate documentation with steps in the method. A navi- 
gator tool may be employed to create a graphical display of 
the steps in the method using data contained in the files. 
Another embodiment of the present invention uses Web- 
DAV-based communications to coordinate access to mul- 
tiple document repositories. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0017] A more complete understanding of the present 
invention and advantages thereof may be acquired by refer- 
ring to the following description taken in conjunction with 
the accompanying drawings, in wliich like reference num- 
bers indicate like features, and wherein: 

[0018] FIG. 1 is a flowchart depicting the steps m a 
metliod for producing more mature products in accordance 
with an embodiment of tlie present invention; 
[0019] FIGS. 2A-2J are flowcharts depicting tlie steps of 
the process stage of organization management in accordance 
with embodiments of the method of FIG. 1; 

[0020] FIGS. 3A-3D are flowcharts depicting the steps of 
the personnel stage of organization management in accor- 
dance witli embodiments of the method of FIG. 1; 
[0021] FIGS. 4A-4F are flowcharts depicting the steps of 
program management in accordance with embodiments of 
the method of FIG. 1; 

[0022] FIGS. 5A-50 are flowcharts depicting tlie steps of 
project management in accordance with embodiments of the 
metliod of FIG. 1; 

[0023] FIGS. 6A-6B are flowcharts depicting the steps of 
delivery management in accordance with embodiments of 
the raeUiodof FIG. 1; 

[0024] FIGS. 7A-7E are flowcharts depicting the steps of 
analysis stage of the delivery management of FIG. 6A in 
accordance with embodiments of the method of FIG. 1; 
[0025] FIGS. 8A-8J are flowcharts depicting the steps of 
design stage of the delivery management of FIG. 6A in 
accordance with embodiments of the method of FIG. 1; 

[0026] FIGS. 9A-9M are flowcharts depicting the steps of 
build and test stage of the delivery management of FIG. 6A 
in accordance with embodiments of the method of FIG. 1; 
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[0027] FIGS. lOA-lOF are flowcharts depicting the steps 
of deployment stage of the delivery management of FIG. 6A 
in accordance with embodiments of the method of FIG. 1; 
[0028] FIGS. IIA-B, 12 and 14 depict systems for imple- 
menting the method of FIGS. 1-1 OF in accordance with 
various embodiments of the present invention; and 

[0029] FIGS. 13A-J illustrate display images from the 
system of FIG. 12 in accordance with a preferred embodi- 
ment of the present invention. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENT 

[0030] As generally illustrated in FIG. 1, tlie present 
invention provides a CMM in a BOX method 10 for easing 
and speeding an organization's transformation toward 
higher levels of the above-described CMM hierarchy. The 
CMM m a BOX method 10 generally comprises the steps of 
getting started 20, organization management 100, program 
management 400, project management 500, and delivery 
management 600. As suggested in FIG. 1, the CMM in a 
BOX metliod 10 performs as a cycle in which actions 
performed during the organization management 100 help 
control the current steps of program management 400, 
project management 500, and delivery management 600. 
Subsequently, the actions performed during program man- 
agement 400, project management 500, and delivery man- 
agement 600 adjust the step of organization management 
100. Each of these steps of CMM in a Box method 10 is 
described in greater detail below. 

[0031] In these discussions, it should be appreciated that 
the various steps of the CMM m a Box method 10 preferably 
include the creation or updatiiig of various documentation 
(or monuments) that detail and verify the execution of tasks 
performed by the organization. These documents may be 
used to demonstrate compliance with the higher levels of the 
CMM or CMMI. Some of these documents are listed 
directly with the associated steps, but a complete listing is 
beyond the scope of the present application. A short listing 
and siunmary of some of the various documents that may be 
created or updated during the steps of the CMM in a Box 
method 10 is listed below in Table 1. 
[0032] The CMM in a BOX method 10 begms with getting 
started step 20. In step 20, the organization prepares to 
initiate the other steps in the CMM in a BOX method 10. In 
particular, the organization may review the requirements of 
the various management steps 100, 300, 400, and 600. 
Similariy, tlie organization may review tlie CMM or CMMI 
and their general requu-ements in order to better understand 
tlie goals to be accomplished during the various steps of the 
CMM in a Box method 10. 
Organization Management 

[0033] As illustrated in FIG. 1, Organizational Manage- 
ment 100 is divided into two stages, process step 200 and 
personnel step 300. The Organization management step 100 
generally concerns activities related to the staicture and 

activities of an organization. The process stage 200 contains 
the methodologies, process flows, tools, and templates to 
create and maintain a Software Engineering Process Group 
(SEPG). It should be noted that in the CMMI, the SEPG is 
replaced by a Process Group to allow for the inclusion of 
systems engineering. Tlius, tliis application uses the SEPG 



to refer to a group overseeing software and non-software 
processes. As suggested by its title, the personnel stage 300 
contains the methodologies, process flows, tools and tem- 
plates to perform organizational design and development, 
measurement performance, and conduct organizational 
training. 

[0034] As depicted in FIG. 2A, tbe process stage 200 
consists of tlie steps of plannmg and organizing a SEPG, step 
201 ; and of managing and improving the organization's 
processes, step 202. Step 201 is flirther subdivided into 
planning SEPG project execution (step 210) and organizing 
SEPG project resources (step 220). Likewise, managing and 
improving tlie organization's processes in step 202 may be 
subdivided into controlling SEPG project work (step 230); 
rolling out and supporting SEPG projects (step 240), com- 
pleting the SEPG project 290, and controlling process 
improvement (step 203). In turn, the step of controlling 
process improvement, step 203, consists of conducting a 
super SQA review, step 250; conducting assessments, step 
260; conducting quarterly surveys, step 270; and conducting 
process improvements, step 280. 

[0035] In the planning and organizing of the SEPG m step 
201, the organization first perfomis the plannmg of the 
SEPG project execution, step 210. While planning SEPG 
project execution in step 210, the SEPG defines its process 
improvement plan and subordinate plans for the fiscal year. 
Since the SEPG is a continuously operating project, plans 
are reviewed :md updated armually, at a minimum, usually 
with the bcgimnng of a new fiscal year. Step 210 begins at 
the initiation of the project to define the pieces of an initial 
project phin and all subordinate plans tliat should be used to 
manage the execution of the project. Using tins information, 
the organization seeks to develop a SEPG project plan, a 
SEPG work plan, a communication and sponsorship plan, a 
configuration management plan, a risk management plan, 
and a training needs matrix, as these objects are defined in 
the CMM. The organization further perfonns decision analy- 
sis and resolution during the plaiming of the SEPG project 
execution, step 210. 

[0036] One possible process for planning tlie SEPG 
project execution, step 210, is generally depicted in FIG. 
2B. In an initial aspect of the planning a SEPG project 
execution, step 210, the organization tailors tlie CMM in a 
BOX metliod 10 as needed. Specifically in step 212, the 
organization detemiines whether to waive or skip steps in 
the CMM in a BOX mediod 10 as required by organization 
or the particular project. For instance, the organization skip 
tasks that are inapplicable to a project and therefore 
unueeded to either achieving higlier levels of maturity in the 
CMM or to develop more mature products. 

[0037] Another step in the SEPG project exeaition, step 
210. is to develop a project plan, step 214. The project plan 
describes the project approach for the project timetable, 
metrics, organization, supplier agreement management, 
comniiuiication and sponsorslnp strategy, training, quality 
initiatives, software system development process, configu- 
ration management, logistics, facilities, tools, and purchas- 
mg. It flirther describes the project approach for training, 
metrics tracking, and roles and responsibilities on the 
project. The organization may also use Decision Analysis 
and Resolution (DAR) to develop the Project Plan, as 
defined in the CMMI. 
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[0038] The orgamzation may further develop subordinate 
plans, step 216. The development of the appropriate subor- 
dinate plans, step 216, satisfies the needs of the project, such 
as tlie creation of subordinate plans for subcontractor man- 
agement, risk management, communication and sponsor- 
ship, and configuration management, all of which are 
described in greater detail below. In the development of 
subordinate plans, step 216, the organization may Ivirther 
create a work plan. For mstance, the organization may create 
a "bottom-up" or task-level project work plan based upon 
estimates where critical paths and dependencies are defined 
and managed witliin a project work-planning tool, such as 
Microsoft Project and Project Workbench®. 
[0039] Another aspect of the SEPG project execution 
process, step 210, is lo develop project estimates, step 218. 
The organization may develop project estimates, step 218, 
using an estimating tool as a starting point for tlie estimates. 
For instance, estimates may be developed using the follow- 
ing steps: (1) tailor tasks and estimating model; (2) deter- 
mine estimating factor values; (3) define work packages; (4) 
determine a timeline for tlie estimate; (5) reconcile a present 
estimate to an initial estimate; and (6) document assump- 
tions used to form the estimates. The organization preferably 
further validates any estimates by verifying estimates 
against estimates or actual results from comparable projects. 
To form accurate estimates of available resources, the orga- 
nization should fiirther consider other resource-tapping 
activities such as cuiiiiniiiuty involvement, recruiting, men- 
toring, and training, when evaluating resources. 

[0040] Reftiming to FIG. 2A, the organization then con- 
tinues the process stage 200 and the plamiing and organizing 
the SEPG, step 201, by organizing the SEPG project 
resources, step 220. During step 220, the SEPG focuses on 
obtaining, assignmg and training its human resources, and 
establisliing the project's other physical resources including 
installation of tracking tools and document repositories. Tliis 
task is perforaied iteratively as needed to organize, mobilize 
and manage SEPG resources lliroiighoiit the execution of the 
project. The organization performs step 220 as needed to 
organize the project's human resources, to establish other 
resources, to make work assignments and to any training 
needed to enable resources, fuming to FIG. 2C, tlie first 
step in organizing the SEPG project resources in step 220 is 
to refine resource needs, step 221. In this step 221, the 
orgamzation defines the team organization structure, sched- 
ules the work, and defines the hiunan and physical resource 
needs of the project. These tasks are performed in view of 
each project's requirements. By refining resource needs in 
step 221, the organization helps to ensure tliat project 
staffing and facilities needs are met on a timely basis without 
affecting the completion date and the quality of tlie work. 
Tlie organization may complete this refining of resource 
needs in step 221 by: (1) determining project organization 
structure; (2) balancing a development schedule using 
human resource guidelines; and (3) refining physical 
resource needs that were outlined in the logistics, facilities, 
and tools section of the project plan formed in step 214. 

[0041] Reniming to FIG. 2C, tlie organization continues 
the organization of the SEPG process resources in step 220 
by establisliing project standards and goals, step 222. The 
establishment of project standards and goals in step 222 is 
accomplished by developing, modifying, and adopting 
administrative and project-specific project standards and 



procedures. Examples of administrative procedures are 
employee availability checklists, time accounting proce- 
dures, status reporting, vacation scheduling, etc. Project 
standards and procedures include design and development 
standards, and the use of project specific tools. 

[0042] The organization continues the organizing the 
SEPG process resources in step 220 through organizing a 
project team in step 223, also illustrated in FIG. 2C. The 
selection of project team members is based on project 
requirements. Other elements in the organization of a project 
team are the finalization of the project team's organization 
structure and documentation in an organization chart in the 
project plan. The organization should fiirther update the 
training needs matrix to document: (1) the training required 
of each project team member and (2) the proposed means for 
fulfilling the training. The training needs matrix is fiutlier 
used to track project team member training. In another 
implementation, organizing a project team in step 223 may 
fiirther require the organization to determine, as a team, tlie 
project's mission, vision, and charter, and then to document 
these determinations in the project plan and orientation 
binder that are created as required to achieve higher maturity 
levels in the CMM. 

[0043] Returning to FIG. 2C, another task in tlie organi- 
zation of SEPG project resources is to establish other 
resources indirectly needed for the SEPG project, step 224. 
Specifically, the organization performs this task by organiz- 
ing the physical resources, such as hardware or software, 
provided by program management and developing the ori- 
entation and/or training needed to support the activities of 
the project team. The establisliment of other resources in 
step 224 helps create a work environment that promotes 
communication, collaboration, and group cohesion. 

[0044] Also, as illustrated in FIG. 2C, the organization of 
SEPG project resources in process 220 fiirtlier includes 
enabling resowces, step 225. An organization performs this 
step 225 to orient and train team members, to coach and 
evaluate team members, and to manage the physical 
resources assigned lo the project. The enabling of resources 
in step 225 aids the project manager in motivatmg and 
challenging team members, while helping to ensure that 
various project persoimel believe their work to be important. 
Specifically, the organization should coimnunicate the 
project's mission, vision, and charter to new team members. 
Large projects may also elect to formalize these items at the 
program level, and projects may conduct one or more 
meetings that include all team workers. 

[0045] Referring to FIG. 2A, another element in the 
process stage 200 is to manage and unprove the organiza- 
tion's processes, step 202. The first step in the management 
and improvement of process is the control of SEPG project 
work in step 230. Dining the control of SEPG project work 
in the step 230, SEPG project management monitors the 
execution of the project against project plan and makes 
adjustments as necessary. Project Status Reports are pre- 
pared for the Project Sponsor. Potential and actual problems 
are identified through the measuring and monitoring of 
progress and performance against tlie SEPG Project Plan. 
Depending on the type of problem identified, an Issue, Risk, 
System Investigation Request (SIR) or Change Request 
(CR) is logged. Tlie SIRs and tlie CRs are described in 
greater detail below. SEPG Project management is expected 
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to take appropriate corrective actions to resolve problems 
that are discovered. The controlling of SEPG project work in 
the step 230 is also illustrated in FIG. 2D and is now 
described in greater detail. The controlling of SEPG project 
work in the step 230 includes releasing work packages, step 
231. Work packages are generally described in the CMM 
criteria and generally relate to the tasks and functions given 
to the various workers in a project. To release work pack- 
ages, the organization should (1) assemble and release work 
packages according to the work plan and (2) conununicate 
the requirements of Ihe work packages to the assigned team 
members. The project team then performs the work needed 
to develop the required deliverable good. During step 231, 
the organization preferably acts to ensure that each team 
member luiderstands assigned responsibilities, including tar- 
get dates and budgets. Furtliennore, the organization should 
implement the project so that each team member (1) is able 
to provide input regarding various responsibilities and (2) 
accepts these responsibilities. 

[0046] As depicted in FIG. 2D, a following task in Uie 
control of SEPG project work, step 230, is measuring 
performance, step 232. The task of measuring performance 
in step 232 generally includes capturing actual results and 
calculation of metrics in order to manage performance. The 
capture metrics are outlined in the SEPG project plan 
formed in step 214 and include cost, effort, scope, quality, 
and schedule. Tlie organization should further track project 
infrastructure and technical requirements, such as hardware, 
software, and perfonnance requirements that were outlined 
during plaiuiing in step 210. The organization should also 
analyze any deviations from the project plan and identify, in 
a timely manner, the causes for the deviations. 

[0047] Concurrent with measuring of performance in the 
step 232 is managing performance, step 233, as illustrated in 
FIG. 2D. Managing performance in step 233 generally 
requires the organization to manage project performance 
against the previously defined project and work plans. To 
manage project performance in view of the project and work 
plans, the organization proactively assesses perfonnance, 
status, quality and risk. Wlicn the actual results from the 
development of the project do not match the plans, the 
organization should further detemiine alternative goals or 
actions. The implementing organization may further obtain 
approval for corrective actions, and then take corrective 
actions. Tlie corrective actions may include, but are not 
limited to, work process changes, team building, training, 
increased or decreased supervision, work assignment 
clianges, reassignment of teajn members, initiation of risk 
responses, die change of requests to be pursued witli pro- 
gram management as part of the configuration management 
process, project replanning changes that specify needed 
modifications to the project plan, project plan revisions 
(work package changes, etc.) or escalation to program 
management. Tlie organization should also reevaluate 
project decisions tliroughout the project life cycle, when 
various project triggers or other issues, risks, etc. arise. Tlie 
organization may also manage team member performance 
according to organizational and industry standanis and tools. 

[0048] Continuing with FIG. 2D, following the measuring 
of perfomiance in step 232 and the managing of perfor- 
mance in step 233, the organization communicates project 
status, step 234. During step 234, the organization generally 
develops and communicates project status to all project 



stakeholders according to the project plan. The project 
stakeholders include project and senior management and 
other affected groups. The organization may fiirther conduct 
status and review meetings involving affected groups as 
appropriate. During the communication of project status in 
step 234, the organization should document meeting minutes 
as required for the CMM. 

[0049] Continuing with FIG. 2D, following the commu- 
nication of project status in step 234, the organization 
obtains acceptance of interim deliverable goods, step 235. 
Obtaining acceptance of interim deliverable goods in step 

235 generally requires tliat the organization obtain accep- 
tance of interim deliverables by all designated stakeholders, 
as appropriate, at key interim points throughout tlie project 
life cycle. Any acceptance of final deliverables takes place 
in connection with completing the program. 

[0050] Concurrent with the above-described steps 231- 
235, another task in the control of SEPG project work in step 
230 is to execute project management processes, step 236. 
Tlie organization should execute step 236 in conjunction 
with other project control activities, such as measurement 
activities and status reporting. Also, the project management 
processes may occur continuously, periodically, or may be 
event driven. One project management process in step 236 
is risk management, which addresses tlie identification, 
analysis, and avoidance/mitigation aspects of risk manage- 
ment on a project. During risk management, the organization 
may perfonn risk identification, during which the organiza- 
tion identifies, names, and describes the various risks. The 
organization should further generate a list of specific incre- 
mental risks in the project's risk tracking tool. For instance, 
the organization may document known triggers for a risk, 
the potential damage for each risk item, and references for 
the sources of risk. Anotlier risk management task in step 

236 is risk analysis, in which the organization analyzes the 
identified risks. In the risk analysis, tlie organization should 
classify the risks and include any additional infomiation 
necessary to support the analysis. The organization may then 
select a rank/prioritized list of top risks. For instance, the 
organization may create a list of the top five risks to a 
project. Another risk management task is risk avoidance and 
mitigation. Risk avoidance activities address the sources of 
a risk, thereby reducing the probability tliat it would become 
a problem. For a top ranked or prioritized risk, the organi- 
zation should identify how the risk can be avoided. Risk 
mitigation measures attack the consequences of a risk, 
reducing the risk's potential impact on the project. For the 
top ranked/prioritized risks, the organization may identify 
actions to reduce tlie impact of the risk if it occurs. The 
organization may also use Decision Analysis and Resolution 
(DAR) to assess the risks, where DAR is defined above. 
Many automated risk management applications are com- 
monly available, and an organization may choose from these 
various risk management applications as needed to best 
fulfill the needs of the organization. 

[0051] Another task in the execution of project manage- 
ment in step 236 is scope management, which addresses the 
acceptance of requirements to define scope and the require- 
ments to change control process. For instance, one scope 
management task is requirements development. During the 
task of requirements development, the organization identi- 
fies and dociunents requirements needed to promote and 
ensure bidirectional traceability, so that the organization 
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may trace requirements between the development and the 
testmg of the requirements. As with all work products, 
requirements are preferably placed under configuration 
management (CM), as defined in the CMMI. Another scope 
management task is requirements acceptance, during which 
the organization documents and reviews requirements with 
all affected groups aid obtains acceptance from the affected 
stakeholders. The organization should fiirther establish base- 
line standards for satisfying the requirements. Another scope 
management task for the organization is making any 
required changes to the requirements and their baselines. 
The organization generally follows tlie project's change 
control process for any clianges to baselined requirements. 
Namely, the organization submits a change request; reviews 
a change request; performs impact analysis, including cost, 
schedule and efforts impacts; determines disposition; imple- 
ments change, including associated impact to other work 
products and activities; and notifies requester and affected 
groups. Again, the organization may determine if it is 
necessary to use DAR to assess changes in scope. 

[0052] Anotlier project management process in step 236 in 
the execution of the project management processes is con- 
figuration management. Tliis task addresses the set of activi- 
ties performed to establish and maintain the integrity of tlie 
project work products tliroughout tlie project's life cycle. 
One set of configuration management tasks relates to con- 
figuration identification activities. During the configuration 
identification activmes, the organization identifies, names, 
and describes each of the configuration items that should be 
placed under configuration management, hi particular, all 
work products should be placed luider some type of con- 
figuration management. During the configuration identifica- 
tion activities, the organization generally uses the CM plan 
to define a baseline for the configuration items and to 
indicate the level of configuration management for each 

[0053] .Another configuration management process in step 
236 is the configuration of control activities. Generally, the 
organization requests, evaluates, approves or disapproves, 
and implements changes to the baselined configuration items 
defined during the configuration identification activities. All 
of tlie configuration items should be archived and plaped 
under the project's documented change control process. 

[0054] Configuration of status accoiuiting activities is 
another configuration management process in step 236. 
During this process, the organization records and reports the 
status of the project's configuration items. Similarly, the 
organization should further perfonn configuration audits. 
Specifically, the organization may, using the CM plan, 
determine the extent to which actual configuration items 
reflect tlie plaimed configuration items. The purpose of this 
task is to ensure that the entire configuration is correct and 
complete. The organization should fiirther document resuhs 
as required in the CMMI. 

[0055] Another project management process of the execu- 
tion of the project management process in step 236 is issue 
management and escalation. This task involves the identi- 
fication and documentation of issues using an issue tracking 
tool, as well as a review of tlie issue and an analysis of any 
impact on deliverables, scope, contingency, resources, costs, 
schedule, and/or quality. Specifically, the organization 
should identiiy a resolution approval party, an issue's owner. 



and determine expected time frames. The organization may 
also determine if it is necessary to use DAR to assess the 
issue, as described above. The organization may further 
research and identify issue solution alternatives. Subse- 
quently, the organization may refer the issue to program/ 
senior management when: (1) the project cannot resolve the 
issue internally, (2) when the issue impedes the progress of 
a project, and when the issue is beyond the authority of tlie 
project manager to resolve. These are generally issues that: 
(1) cannot be resolved within a project team, (2) are resolv- 
able with action items, (3) can be escalated to the next level, 
(4) Are reactively discovered during tiie course of develop- 
ment, (5) affect program/project scope, costs, schedule, 
projected business performance, or high level design, (6) 
affect multiple projects or releases, and/or (7) involve groups 
outside the project that affect project delivery. Tlie organi- 
zation should accordingly monitor issues stams and approve 
or reject resolutions. At the same time, tlie organization 
should communicate resolutions to stakeliolders and 
affected parties and take corrective action as described 
above in the context related to management of performance 

[0056] Returning to FIG. 2D, another step during process 
of controlling tlie SEPG project work in step 230 is updating 
the project plan and subordinate plans, step 237. In particu- 
lar, throughout the life cycle of tlie project, tlie project plan 
and subordinate plans (Risk Management, Configuration 
Management, Work Plan, Subcontractor Management Plan, 
Community and Sponsorship Plan) should be updated as 
appropriate by the organization to reflect any changes on the 
project that would effect the content of the documentation. 

[0057] Referring again back to FIG. 2A, another task of 
tlie management and improve process 202 in project stage 
200 is tlie rollout and support of SEPG projects, "step 240. 
During the rollout and support of SEPG projects in step 240, 
new projects to be supported by the SEPG are identified and 
SEPG processes and tools are delivered to them. SEPG 
Liaisons may conduct process reviews of the SF;PG-sup- 
ported projects. Other project-created items referenced dur- 
ing the rollout and support task include the Service Level 
Agreement, Tailoring & Waiver Request, Metrics Workbook 
and Metrics Plan. Tlie organization perfonns this task of step 
240 to rollout SEPG processes and tools tliroughout the 
organization. The process of rollout and support of SEPG 
projects in step 240 is illustrated in greater detail in FIG. 2E. 
Specifically, the rollout and support of SEPG projects in step 
240 comprises the steps of identifying new projects, step 
241; assigning a SEPG liaison, step 242; conducting a 
project kickoff, step 243; approving or disapproving waiv- 
ers, step 244; collecting project metrics, step 245; conduct- 
mg best practices reviews, step 246; reporting best practices 
status, step 247; and conducting project close out, step 248. 

[0058] Referring to FIG. 2E, during the identification of 
new projects in step 241, the organization should identify 
new projects that are in the planning stages. Then, in step 
242, a SEPG rollout team leader assigns a SEPG liaison by 
evaluating the current workload among the available SEPG 
liaisons and select the most appropriate SEPG liaison for the 
current project. Tlie rollout team leader preferably discusses 
the assignment with the SEPG liaison and sends a memo to 
the SEPG liaison uiformuig him or her of the assigmiient, 
with a copy to the project manager and the SEPG program 
leader. 
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[0059] Continuing with FIG. 2E, the next step of con- 
ducting a project kickoff in step 243 is conducting a kickoff 
meeting, preferabjy within 2 weeks of notification of support 
to be provided by SEPG. Tlie SEPG liaison should schedule 
a time to meet with the project management team to discuss 
the kickoflF. The SEPG liaison should also ask a project 
manager for project documentation such as the proposal, the 
statement of work, estimating tool estimates, and the work- 
plan, if available. This discussion is to establish the project 
organization, identify projects to support, and to ascertain 
the scope of the SEPG effort, 

[0060] Referring again lo FIG. 2E, the next task in the 
rollout and support of SEPG projects m step 240 is to 
approve or disapprove waivers, step 244. In particular, the 
SEPG liaison or SEPG manager should work with the 
project or proactively identify any area where a project may 
need a waiver. A waiver request template should be available 
tlirough the SEPG or through the SEPG liaison. A senior 
management official should sign the waiver request form, 
thereby acknowledging its risk and impact to the project. 
Also, the SEPG liaison should review the waiver request 
form for completeness and determine the disposition of the 
waiver request. Tlie SEPG liaison then forwards the waiver 
request form to the SEPG project manager with a recom- 
mendation for disposition. Subsequently, the SEPG liaison 
infonns the project manager of the disposition of the waiver 

[0061] Continuing with FIG. 2E, the next task is to collect 
project metrics, step 245. Step 245 may include one or more 
undertaking that help to ensure that the project metrics are 
collected in an organized and efficient manner. These under- 
takitTgs may include collecting monthly project metrics, 
collecting best practice reviews, collecting quality review 
results, collecting stakeholder scorecard data, and collecting 
people satisfaction survey results. 

[0062] Continuing with FIG. 2E, another step is to con- 
duct best practices reviews, step 246. With tlie conducting of 
best practice reviews, tlie SEPG liaisons should conduct 
monthly best practice reviews with project management in 
order to track and monitor compliance with CMMI require- 
ments. The review criteria are based on the CMMI process 
areas and can be found witliin a best practices matrix. The 
reviews identify nonconfoniiance items and areas for 
improvement. The SEPG liaisons should review the infor- 
mation gathered from the team and enter comments uito die 
notes/comnents section of the first best practice review 
matrix. During the meefing, the SEPG liaisons and project 
managers should review the matrix and determine which 
items have been met and those tliat would require additional 
information or documentation (artifacts). Based on the 
review, the SEPG liaisons should complete the best practice 
matrix with documentation on additional information 
required from the project. Once the project reaches substan- 
tially complete compliance with the identified best practices, 
tlie best practice review focus becomes one of continued 
compliance and includes project team leaders and project 
team members. The SEPG liaisons should document and 
spot-check areas for compliance based on past reviews. 
These interviews may be conducted with or without project 
management in step 500. described below. 

[0063] Continuing with FIG. 2E, the next step is to report 
best practice status, step 247. Tliere are two ways to report 



on the best practice status. The SEPG 1 iaison may document 
Non-Conformance Items (NCI) and issues in a best practice 
notes/comments section and submit tliis to project manage- 
ment after the conclusion of the Best Practice review, 
preferably within two days. Tlie project manager generally 
has a short time, such as one week, to provide a response for 
each NCI, including a target completion date for correcting 
tiie NCI. Alternatively, the SEPG liaison may complete a 
best practice "Dashboard" report with updated scores, open 
items, and risks. The report should be sent to project 
management and SEPG rollout and program leaders. 

[0064] Continuing with FIG. 2E, the next step is to 
conduct project close out, step 248. Tlie organization may 
implement phase close out. In phase close out, the SEPG 
liaison may approve or disapprove tlie waivers, collect 
project metrics, conduct best practice reviews, and report on 
best practice status, etc. This process of rolling out and 
support of SEPG projects, along with the control of process 
improvements (step 203) described below, may then be 
repeated until the project is closed out. Next, in project 
closed out, the SEPG liaison works witli tlie project manager 
and the management team to evaluate the overall impact and 
value of the SEPG program on the project. This evaluation 
should be done througli the completion of a project close-out 
memo, verification of updates to the internal corporate 
resource by the project knowledge champion, verification of 
submission of the project's actual and estimated values to 
ownen; of the estimating tool via die profiling tool, collec- 
tion of final project metrics, and collection of best practice 
and SEPG suggestions and comments. 

[0065] Following the conducting of the close out in step 
248, the organization may complete the SEPG projects in 
step 290, as depicted in FIG. 2.1. To complete the SEPG 
projects in step 290, the SEPG Liaison reviews the Closing 
Memo and SQA Debrief created by projects that are com- 
plete and no longer require SEPG support. Specifically, the 
organization veriiy the completion of the supported projects, 
review the documentation produced in steps 230 and 240, 
and generate a list of best practices as desirable to produce 
a more mamre product, respectively steps 292-296. 

[0066] Referring back to FIG. 2A, another task of the 
management and improvement process, step 202, m the 
project stage 200 is to control process improvements, step 
203. The control of process improvements in step 203 brings 
together the tasks associated with controlling and conduct- 
mg process improvement. As highlighted in the methodol- 
ogy, the Control Process Improvement, Rollout & Support 
SEPG Projects, and Complete SEPG Projects tasks are 
iterative in nature. Once processes and tools are improved, 
the SEPG is responsible for delivering these new processes 
and tools to its projects. Improving the control process in 
step 203 is comprised of the following steps: conducting a 
super software quality assurance (SQA) review (step 250), 
conducting mini-assessments and appraisals (step 260), con- 
ducting iiitennittent surveys (step 270) and conducting pro- 
cess improvements (step 280). 

[0067] One aspect of improving the control process in step 
203 is to conduct a super SQA review, step 250. hi step 250, 
the SEPG plans and organizes a Super Software Qualit)' 
Assurance (SQA) review of its documents. A report is 
prepared based on the findings and reviewed with the SEPG 
Team. The results of this review help the SEPG to improve 



us 2006/0235732 Al 



8 



Oct. 19, 2006 



internal processes. The organization performs this step 250 
to conduct software process and work product quality assur- 
ance reviews to verify project adherence to standards and 
procedures, such as any identified best practices. The quality 
program section of the Project Plan is described above in 
greater detail within the text accompanying FIG. 2B. Turn- 
ing to FIG. 2F, the process of conducting a super SQA 
review in step 250 is described in greater detail. The first 
task of conducting the super SQA review in step 250 is to 
complete a SEPG project plan. In step 251, the process 
improvement (PI) team leader typically (1) identifies docu- 
ments and processes to be reviewed; (2) ensures that docu- 
ments in the Project Plan and Work Plan are consistent; (3) 
identifies Super SQA reviewers, reviewees, and review 
criteria, (4) identifies roles and responsibilities; (S) identifies 
SQA metrics; (6) references the SQA plan in tiie quality 
section of the project plan; and (7) creates the SQA Plan. 

[0068] In the next step of conducting the super SQA 
review of step 250, the organization prepares for the super 
SQA review, step 252, as depicted in FIG. 2F. In one 
implementation of step 252, the PI team leader sets the super 
SQA review expectations. The PI team representative also 
submits reminder notifications to the super SQA reviewer 
based on any scheduled super SQA reviews, provides the 
Super SQA Reviewer with the Super SQA Reviewer training 
presentation and the SEPG Program SQA Plan, and provides 
the super SQA reviewer with standards and supporting 
documents to be reviewed. The PI team representative may 
further provide the super SQA reviewer with document 
owner contact and availability information, as defined in the 
CMMI. The super SQA reviewer then typically gathers and 
reviews criteria/standards and supporting documents fi-om 
the PI team representative, reviews any super SQA reviewer 
training presentation, and schedules meetings with docu- 

[0069] Referring to FIG. 2F, the next step of conducting 
the super SQA review of step 250 is to conduct the super 
SQA review, step 253. The super SQA reviewer should 
review processes and dociunents against review criteria/ 
standards, conduct interviews with document owners, iden- 
tify nonconformance items, and follow up with the docu- 
ment owners as needed for meeting with the requirements of 
the desired CMM level. The document owner participates in 
the interview widi the super SQA reviewer and remams 
available to answer questions. Tlie PI Team Leader should 
also remain available to answer questions. 

[0070] In the next step 254, the organization, through the 
SQA reviewer, prepares an SQA report to document a 
detailed summary of findings and recommendations, as 
illustrated in FIG. 2F. Specifically, the SQA Report should 
inchide an item number, the date reported, and an accurate 
description of nonconformance items. The SQA reviewer 
may fiirther distribute the SQA Report to the PI Team 
Leader, and schedule discussion of nonconformance items 
witli the SEPG Program Lead. Tlie PI team representative 
also prepares and documents responses in the SQA Report, 
including an indication of whether the PI teatn representa- 
tive agrees or disagrees with the reason statement, or oth- 
erwise determines the findings to be not appHcable to the 
particular organization or project. 

[0071] Subsequently, the organization should discuss non- 
conformance items, step 255 in FIG. 2F. In step 255, the 



super SQA reviewer typically schedules and conducts a 
discussion of nonconformance items with the PI team leader, 
as well as verifying an adequate resolution of nonconfor- 
mance items. Likewise, the PI team leader should discuss 
nonconformance items with the Super SQA Reviewer and 
refer disagreement items for facilitation to the SEPG Pro- 
gram Leader. A PI team representative should update tlie 
SQA report with proposed resolution(s) and projected 
completion date(s) for proposed changes/actions, and update 
and return the report, as well as all necessaiy documents, to 
the SQA reviewer for verification. The PI team representa- 
tive fiirther creates the System Investigation Requests (SIRs) 
and/or Change Requests (CRs) as necessary for the CMMI. 
The SIRs correspond to reports created to document errors 
in the product, and CRs conversely correspond to enhance- 
ments in the product that are beyond the scope of the original 
product. A SEPG liaison may then review and resolve 
escalated nonconformance items. 

[0072] Returning to FIG. 2F, the next step of conducting 
the super SQA review of step 250 is to track the super SQA 
metrics, step 256, by having the super SQA reviewer send 
tlie final report to the PI team leader. The PI team leader then 
forwards the final report and metrics to SEPG program 
leader, including metrics such as SQA schedule variance, 
and the number of nonconformance items. The PI team 
leader further tracks and reports on all open nonconfor- 
mance items, while keeping project copies of docmnenta- 
tion/reporls. 

[007.1] Returning to FIG. 2A, the next step in improving 
the control process in the step 203 is to conduct assessments, 
step 260. In step 260, the SEPG coordinates activities to 
determine the state of an organizations processes and prac- 
tices. Tliis assessment can take many forms and can range 
fi"om informal process assessments, mini-appraisals or fiiU- 
scale evaluations. In any of these situations the organization 
can utilize outside contractors to conduct the review. Step 
260 generally includes tliree stages: preparation, an on-site 
period, and wrap-up. After a series of interviews and review 
of documentation, the assessment results are then presented 
back to the organization. The organization should follow the 
same basic process when conducting an appraisal. In botli 
cases, the organization may utilize an extemal group to 
execute the miiii-appraisal and/or assessment. The process 
of conducting the mini-assessments and appraisals in step 
260 is more fully illustrated in FIG. 2G. 
[0074] As depicted in FIG. 2G, the first task in the 
assessments m step 260 is to select projects, step 261. In step 
261, the organization carefully selects projects used for the 
assessment in order to paint an accurate picttire of the 
organization's processes. Generally, from one to four 
projects should be selected for assessment. Projects may be 
selected using tlie following criteria: (1) tlie project should 
be representative of the work (present and fiitiire) of the 
organization, and aligned witli the business objectives of the 
oi^anization; (2) the project should have at least six people 
working on it; (3) the project should have a duration of 
greater than tliree niontlis; and (4) the project should not 
have a critical activity or milestone during the on-site period. 
Additionally, at least one of the projects should be in the 
build stage. Personnel from the selected projects should also 
be available for interviews and presentations. 
[0075] Returning to FIG. 2G, the next task in the mini- 
assessment and appraisal is to assess the development of an 
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onsite schedule, step 262. The core of the assessment during 
step 260 is made up of the onsite period, which usually lasts 
from five to ten days. The onsite period consists of three 
basic activities; (1) gathering information through interview 
sessions with project leaders, team leaders, and functional 
area representatives; (2) mapping information to processes 
areas within the scope of the assessment through consoli- 
dation sessions; and (3) reporting findings and observations 
back to the oiganization through preliminary and final 
findings presentations. An executive session and a debriefing 
session is conducted to wrap up the on-site period. There is 
no limit to the number of hours spent on a particular activity; 
however, the assessment team is bound to the tasks that need 
to be completed before tlie next day. Training the assessment 
team is the other activity that can be considered part of the 
onsite period, as required, and can be sclieduled just before 
the assessment activities begin. 

[0076] As depicted in FIG. 2G, the next step in step 260 
is to prepare assessment logistics, step 263. During step 263, 
a local assessment coordinator works with the assessment 
team leader to identify and prepare the logistics for con- 
ducting the on-site period. Logistical preparations include 
reservation of rooms for the on-site period (presentation, 
interview, and assessment team rooms); computer and pre- 
sentation equipment (projectors, LAN connections, access 
to a phone, printer, copier, and general supplies); arranging 
for food and beverages, as well as accoinmodations for the 
assessment team, and confirming building/ofTice access for 
the assessment team during the on-site period. 
[0077] The next step in step 260 is to select assessment 
participants, step 264, as depicted in FIG. 2G. In tlie 
selection of assessment participants in step 264, a good cross 
section of the oiganization must be considered when select- 
ing assessment participants. This is done through interview- 
ing individuals from each selected project, including the 
project leader, project team members, as well as personnel 
from supporting groups, such as quality assurance, configu- 
ration management, and/or the database group. Individuals 
who have been involved in developing or maintaining 
software in the organization also should be included in the 
list of interviewees. Participants selected for the assessment 
should come from different parts of the project life cycle, 
have at least six months of experience with the organization 
(and at least three months with the project), and be able to 
articulate their observations and opinions about the organi- 
zation and its projects. Selected participants preferably can 
dedicate from six to eiglit hours to the assessment activities 
during ihe on-sile period. For the assessment to take place, 
tlie assessment sponsor must be present for the initial and 
final presentations. 

[0078] Returning to FIG. 2G, the next step in the mini- 
assessment and appraisal is to develop organizational aware- 
ness of CMMI, step 265. The organization performs this task 
to train assessment participants on what the assessment will 
involve, how the assessment will be conducted, and what the 
organization expects of assessment participants. Awareness 
activities may include training sessions and distribution of 
awareness materials to everybody in the organization. Tlie 
assessment sponsor, or the organization's management (if 
different from the sponsor), must demonstrate their total 
support for the initiative. 

[0079] As depicted in FIG. 2G, the next step in the 
mini -assessment and appraisal is to collect process informa- 



tion, step 266. Step 266 is performed in preparation for the 
assessment of the collection of tlie documentation used in 
the current management and technical processes. Selected 
members of tlie organization fill out a maturity questiomiaire 
to provide a baseline for scoping the assessment. The 
appropriate process documentation from both the organiza- 
tion and the projects being assessed should be collected to be 
reviewed by the team for the purpose of developing the 
assessment findings and observations. A documentation 
mdex should be created and, if required, the collected 
documents should be mapped to the CMMI process areas. 
[0080] Retuimng to FIG. 2G, the next step in step 260 is 
to conduct the assessment, step 267. In step 267, the 
assessment team visits the organization with the objective of 
mapping the organization's management and development 
processes against the CMMI. In particular, the assessment 
team should be trained. The assessment team should further 
conduct an opening meeting and inter%'iew project leaders, 
team leaders, and fimclional area representatives. The 
assessment team should further review collected documen- 
tation and consolidate information gathered and map it to 
process areas in the CMMI. Subsequently, the assessment 
team should conduct follow-up interviews, as required, and 
prepare and present preliminary findings to management and 
stafl". Likewise, the assessment team should prepare and 
present final findings to the organization, incorporating 
feedback received from the preliminary findings presenta- 
tion. The assessment team then conducts any executive and 
debrief sessions and prepares a final report. At the conclu- 
sion of the assessment, tbe assessment team files an assess- 
ment report with the Software Engineering Institute (SEI), 
mcluding with the assessment the final presentation and tlie 
summary report. 

[0081] Returning to FIG. 2A, the next step in improving 
tlie control process in step 203 is to conduct a quarterly 
survey, step 270. The organization performs step 270 to 
receive feedback from projects regarding the SEPG pro- 
cesses and tools. During step 270, the SEPG designs and 
delivers a quarterly Process Improvement Survey to the 
projects it supports. The results of tliis survey are an input 
into the SEPG team's Process Improvement efforts. While 
named a quarterly survey, it should be appreciated that the 
survey may occur at other intervals and time periods. Resuhs 
of this survey should be used to improve SEPG processes 
and tools. The process of conducting the quarterly survey in 
step 270 is depicted in FIG. 2H. The first task is to develop 
a sur\'ey process, in step 271, for administering the process 
improvement survey. Tliis survey may be administered by 
tlie SEPG. Tiie responsibilities for this task should be 
assigned to a sub-team. In developing the survey in step 271, 
the organization should consider the effect of the survey 
transmission medium and the methods tlirough which the 
survey results will be analyzed. The organization should 
next develop the survey questions, step 272. The organiza- 
tion should select question on which the SEPG would like to 
receive feedback. Preferably, when developing survey ques- 
tions, the organization should choose nonleading questions. 
Tlie organization should also preferably use a response scale 
that can be easily quantified, such as the Lickert scale. The 
organization should next, in step 273, administer tlie survey 
using the medium chosen in step 271. At tins point, in step 
274, the organization may evaluate and analyze the survey 
results received from respondents using the process devel- 
oped in step 271 . The organization may then use the survey 
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results to improve the SEPG processes and tools, step 275. 
During step 275, the organization may also publicize the 
results of the survey. 

[0082] Returning to FIG. 2A, the next step in improving 
the control process in step 203 is to conduct process 
improvements, step 280. The organization performs step 280 
to manage process improvement activities. During step 280, 
tlie SEPG takes the feedback it received from the SQ.4 
review, assessments, quarterly surveys, and feedback from 
other sources, and begins translating this feedback into 
improvements in SEPG processes and tools. Results from 
step 280 will be used to maintain, update, and develop SEPG 
processes, tools, and assets. Step 280 is illustrated in greater 
detail in FIG. 21. 

[0083] As depicted in FIG. 21, the first step in conducting 
process improvements is to maintain and improve processes 
and tools, step 281. In step 281, anyone in tiie organization 
and its external reviewers may identify a process improve- 
ment opportunity (witli a process, template, training, stan- 
dard, tools, or the document repository itself). This could be 
in the form of an error (through a SIR), an improvement, an 
enhancement request (tlirougli a CR), or any other process 
improvement concern. The process improvement team 
leader should examine the process improvement opportu- 
nity, and a decision may be made on implementing the 
process improvement. If it is determined that the changes 
will be incorporated into the appropriate process asset 
(process, template, standard, training, etc.) in accordance 
with SEPG standards, then a SIR or CR may be documented 
to capture the change. 

[0084] Returning to FIG. 21, the next step in conductmg 
process improvements, step 280, is lo define and update 
processes and tools, step 282. In step 282, anyone in the 
organization may identify a new process or tool to be 
defined, documented, and/or built. The first type of process 
to be created is an internal SEPG process that uses a new 
process template to document process flows and descrip- 
tions. The second type of process to be created includes 
processes and tools that are part of the SEPG methodology. 
Process definition is submitted to a SEPG team leader for 
review and approval. If a process is approved, it will be 
scheduled for release to tlie organization and/or SEPG team, 
depending on the type of process submitted. 

[0085] As depicted in FIG. 21, the next step in conducting 
process improvements, step 280, is to pilot processes and 
tools, step 283. Once the process or tool to be piloted has 
been completed and approved, it is time to detemiine the 
pilot group, time frame, scope and fijnctionality, roles and 
responsibilities, and entry and exit criteria, as part of step 
283. The SEPG program manager may then work with a 
process asset owner to communicate the pilot's scope and 
expectations with the pilot group. Tlie pilot group will be 
trained on the use and implementation of the process asset. 
Tlie pilot is conducted with the process asset owner provid- 
ing support to the pilot group in terms of providing clarifi- 
cation, additional training, or teclmical support, as neces- 
sary. At the end of tlie pilot period, the process asset owner 
debriefs witli tlie pilot group or at least with a representative 
of the group to evaluate the pilot. Strengths and weaknesses 
of the process are identified, documented, and addressed. 

[0086] Remming to FIG. 21, the next step in conducting 
process improvements, step 280, is to roll out processes and 



tools, step 284. In step 284, once feedback from the pilot 
group is incorporated into the process asset, it will be rolled 
out to the organization and/or SEPG team, as necessary. In 
step 284, the SEPG liaisons have the primary responsibility 
of communicating the new processes and tools to the oiga- 
nization's projects. 

[0087] Returning again to FIG. 21, the last step in con- 
ducting process improvements, step 280, is to assess and 
evaluate processes and tools, step 285. During step 285, the 
organization determines how processes and tools will be 
evaluated. The organization may further conduct intermit- 
tent or quarterly process improvement surveys. 

Personnel Stage 

[0088] Remming to FIG. 1, a second process within the 
organization management step 100 relates to persoimel 
management, step 300. The actions of step persoimel man- 
agement in slep 300 generally relate to acquiring, organiz- 
ing, and training the organization's personnel as needed to 
encoiirage the development of more mature products and 
achieve higher levels of CMM maturity. Organizational 
Training of step 300 is generally necessary to enable per- 
somiel to develop skills to meet specific roles and respon- 
sibilities during solutions delivery in step 600 described 
below. The process of personnel management is generally 
depicted in FIG. 3A and comprises the actions of designing 
a performance measurement infrastructure, step 310; execut- 
ing organization design and development, step 320; and 
designing and deploying training, step 330; and is now 
briefly described. 

[0089] The designing of a performance measurement 
infrastructure in step 310 generally relates to planing activi- 
ties related to performance measurement to provide the 
oiganization with a means for judging the effectiveness of 
the organization. The designing a performance measurement 
infrastructure in step 310 is surrmiarized in FIG. 3B. Tlie 
first step in step 310 is to validate and reach agreement on 
organization strategy, step 312. Step 312 generally involves 
the organization's key stakeholders in the development 
and/or validation of the organization's strategy, specifically 
the organization's mission, vision, and overall objectives. 
Because performance measurement cascades down from the 
oiganization strategy, the organization's strategy should be 
understood and agreed upon by those accoimtable for imple- 
menting it. 

[0090] Retimiing to FIG. 3B, the next step in designing a 
performance measurement infi-astructure in step 310 is to 
produce a performance measurement scorecard, step 314. In 
step 314, tlie organization uses a balanced scorecard to 
measure performance. The balanced scorecard is a measure- 
ment tool that translates strategic objectives into a coherent 
set of perfomiaiice measures. The scorecard is "balanced" 
because it measures both leading and lagging indicators. 
These indicators are expressed in financial and nonfinancial 

[0091] Subsequently, in step 316, the organization imple- 
ments the scorecard, as depicted in FIG. 3B. Implementing 
the scorecard generally requires that the specific information 
for peribrniance goals, metrics, and targets be collected from 
the front lines. Furtliemiore, the organization should com- 
pile at the strategic level each performance perspective, 
objective, metric, and target. .Also, the organization should 
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create and communicate top down, bottom up, and interac- 
tive perfonnance measures. Subsequently, the organization 

should solicit feedback to test the effectiveness of metrics 
and how the performance measures fit in with the organi- 
zation strategy. 

[0092] Turning to FIG. 3C, the next step in the personnel 
stage 300 is to execute the oigani2ation design and devel- 
opment, step 320. The organization performs step 320 to 
plan activities related to organization design and develop- 
ment. Step 320 involves coordinating the tasks associated 
with defining a strategy for the organization, assessing the 
organization against this strategy, and deigning and imple- 
menting a new organization. Note tliat step 320 assumes that 
the organizafion has a Human Resource Organization with 
the skills to design and implement new elements of the 
organization. The organization should to have experience in 
organization design and development. The substeps of the 
organization of design and development in step 320 are 
illustrated in FIG. 3C. 

[0093] The first task in step 320, as illustrated in FIG. 3C, 
is to identiiy an otganization strategy, step 321. In step 321, 
business outcomes, core competencies and guiding prin- 
ciples are defined. These definitions will position the otga- 
nization relative to business goals and objectives, vision and 
mission, management philosophy, customer values, critical 
behaviors and competitive environment. Specifically, the 
otganization should identify an organization strategy before 
detailed organization design. The organization should be 
designed to reflect not only where the company is relative to 
strategy, philosophy, and the value proposition of its cus- 
tomers, but also where it needs to acliieve a competitive 
advantage in the future. The otganization strategy sets the 
direction by defining business outcomes, core competencies, 
and guiding principles that will be used to anchor tlie 
organization design and development process. 

[0094] As depicted in FIG. 3C, the next step in the 
execution of tlie organization design and development in 
step 320 is to conduct an organization assessment, step 322. 
It should be noted that the assessment differs from assess- 
ment used with SEPG. The organization assessment helps to 
identify the supports and barriers to transfomiatioii and build 
a case for implementation. An organization assessment in 
step 322 consists of assessing an organization's current 
situation, its fiiture aspirations, and the gap between them; 
then identifying the initiatives required to fill these gaps. In 
step 322, enablers and barriers to organizational transfor- 
mation are identified and a case for implementation is buih. 
This is accomplished through an assessment of the current 
organizational environment and future organizational aspi- 
rations, identifying the gaps between these two, and identi- 
fying a course of action to close those gaps. 

[0095] Referring to FIG. 3C, the next task in step 320 is 
to design an organization infrastructure, step 323, to create 
structures established to form individuals into the desired 
performing organization. The organization infrastructure's 
goal is to allow workers to effectively accomplish their tasks 
within the business process so that an overall goal is met. In 
step 323, the organization will design a competency model 
and design roles, jobs, teams and organizational structures. 
The competency model definition will document the knowl- 
edge, skills and other attributes/abilities associated with high 
performance on a job. Tlic roles, jobs, teams and organiza- 



tional structures will document the responsibilities associ- 
ated with: tlie individual (roles), groups of related roles 
(obs), groups of jobs (teams) and the span of control, 
reporting relationships and functional relationships of all of 
these components. Step 323 has two subtasks — to design a 
competency model, step 324, and to design roles, jobs, 
teams and an organization structure, step 325. Steps 324-325 
may be conducted itetatively and/or concurrently. In design- 
ing a competency model in step 324, the organization should 
group together related competencies to form a competency 
model. A competency is a cluster of related knowledge, 
skills, and other attributes/abilities associated with higli 
performance on a job; and a competency model is a group 
of related competencies required to perform a career field 
such as team leader or technical coach. Similarly, during the 
process of designing an organization structure in step 325, 
the organization defines the roles played by individuals, the 
jobs they hold, the teams in which they work, and the 
relationsliip between teams. The organization should logi- 
cally define roles for individuals on the basis of their 
competencies, as decide in step 324. 
[0096] Returning to FIG. 3C, the next task in step 320 is 
to verify and validate an organization structure, step 326. In 
step 326, all components of the newly defined organizational 
infrastructure and reviewed to verify and validate that tliey 
meet the needs and goals of the organization. Specifically, 
the otganization should verify and validate tliat any new 
organization design meets the needs of the business and is 
internally consistent. The otganization should flirther con- 
finn tlie new organization design with any subject matter 
experts and initiative sponsors. Continuing with step 326, 
the organization should organize review sessions to validate 
how well the components of the new organization design 
(roles, jobs, teams, organization infrastructare, perfonnance 
management infrastructure) fit together to support new ini- 
tiatives. 

[0097] The next task in step 320, as illustrated in FIG. 3C, 
is to design a performance management infrastmctiire, step 
327. In step 327, Uie organization's perfonnance measure- 
ment scorecard is developed based on the organization's 
strategic objectives. This scorecard is then used to measure 
the organization's performance. Note that tliis task assumes 
that the organization has a Human Resource Organization 
with Hie skills to design and implement a perfonnance 
measurement scorecard, and that the otganization has expe- 
rience in organizational performance management. Tlius, in 
step 327, the organization defines a means for assessing, 
rewarding, and developing the individuals in an organiza- 
tion. Tlie performance management infrastructure has four 
components; (1) designing the performance management 
approach; (2) designing the perfonnance appraisal instru- 
ments; (3) designing career progression; and (4) designing 
the compensation and reward structure. Overall, the otga- 
nization should estabhsh a system to reward individuals for 
desired contributions. 

[0098] The final task in step 320 is to determine an 
organization infrastructure mobilization approach, step 328, 
as illustrated in FIG. 3C. In step 328, the organization 
detennines and mobilizes the resources required to staff the 
new organization infrastnicUire established in step 323. The 
organization may determine profiles for the ideal candidates, 
determine sizing and timing needs, and determine a sourcing 
approach. For instance, candidates may be profiled to fit job 
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descriptions, the organizations new size may be determined 
and an approach to sonrcing and staffing jobs may be 

finalized and executed. 

[0099] Returning to FIG. 3A, the next process in the 
personnel stage 300 is to design and deploy training, step 
330. In step 33, the training needs of the organization are 
analyzed and a Training Plan is created, training is designed, 
developed and deliverer and post implementation support is 
provided. The organization performs step 330 to plan activi- 
ties related to training employees. Tlie design and deploy- 
ment of training during step 330 is illustrated in greater 
detail in FIG. 3D. As illustrated in FIG. 3D, tlie first task in 
step 330 is to conduct a training needs analysis, step 331, 
during which tlie organization identifies, by name, the par- 
ticipants to be trained, along with the courses and modules 
on which these participants will be trained. In step 331, 
target audiences and participants are identified, and training 
courses and modules are planned. The training needs analy- 
sis in step 331 may be conducted in two phases. During tlie 
first phase, the organization gathers the high-level training 
needs for the organization. Similarly, the second phase 
consists of gathering the detailed training needs for the 
organization. 

[0100] Returning to FIG. 3D, the next task in FIG. 3D is 
to develop a training plan, step 332, as needed, to describe 
the organization's overall training approach. In step 332, tlie 
overall organizational approach to training is documented. 
The training plan formed in step 332 may include any of 
following sections/topics: Objectives; assumptions; overall 
training approach; training courses, modules, and topics; 
training timeline; training logistics; and training evaluation. 

[0101] Tlie next task in step 330, as illustrated in FIG. 3D, 
is to design training, step 333. In step 333, the training 
standards, templates, instructor and participant guides and 
the actual layout/format of training are developed. Specifi- 
cally, the organization may develop the layout/format for the 
training materials. The development includes developing 
training development standards as well as templates for any 
instructor and participant guides. 

[0102] Similariy, the next task in step 330, as illustrated in 
FIG. 3D, is to develop training, step 334. In step 334, course 
content is created using the materials compiled during the 
training design step 333. The organization may implement 
step 334 by creating the course content using the training 
development standards and instructor and participant guides. 
Other material created in step 334 may include "Train-the- 
Trainer" materials, visuals, job aids/handouts, and tracking 
documents. Using the training materials developed during 
step 334, the organization may deliver training, step 335, 
such as a Train-the-Trainer session, a pilot training session, 
and the actual training. 

[0103] Returning to FIG. 3D, the next task in step 330 is 
to provide post-implementation support, step 336. In par- 
ticular, during step 336, the organization should provide a 
short-term dedicated staflF (e.g., one or two weeks) to support 
the users in applying what they've learned on the job. 
Furthemiore, the support staff should be available to answer 
questions, identify and troubleshoot issues, and share best 

[0104] Througliout steps 200 and 300, as well as other 
steps in the CMM in a Box Method 10, the organization may 



need to commit to one or more actions (not illustrated) as 
required to achieve higher maturity levels in the CMM or the 
CMMI. Commit points are major decisions regarding report- 
ing the progress of present work and obtaining authorization 
to continue. Commit points define the boundaries of each 
stage around key decisions related to content, context and 
course of action. For instance, a commit point may be 
implemented prior to the executing and design of an orga- 
nization infrastructure in step 320, to require that the design 
of the new organization structure must be approved before 
fijrther implementation can proceed. 
Program Management 

[0105] Retoming to FIG. 1, a second primary component 
of the CMM in a BOX method 10 of the present invention 
is program management step 400. Program management 
step 400 generally concerns activities directly related to the 
creation and refinement of a program for implementing the 
CMM in a BOX method 10. Specifically, program manage- 
ment 400 focuses on the continuous oversight needed to 
support the delivery of a business solution through multiple 
projects and releases. Appropriate disciplines, teclmiques, 
and tools are used in step 400 to plan and organize tlie work, 
and to manage the incremental delivery of the new business 
solution. As illustrated in FIG. 4A, the program manage- 
ment stage 400 generally comprises tlie steps of justifying 
the program (step 410); planning the program execution 
(step 420); organizing program resources (step 430); con- 
trolling program work (step 440); and completing the pro- 
gram (step 450). Tliese individual steps are now described in 
greater detail. 

[0106] As depicted in FIG. 4A, the organization may first 
justify the program, step 410. In step 410, a Program 
Business Case is prepared. The program business case 
approach is referenced to develop the business case. Tiie 
business case is designed to secure stakeholder support for 
the program. Topics of tlie business case include the pro- 
gram's understanding of the current problem, the proposed 
solution to the problem that is to be unplemented by the 
program, and a cost/benefit analysis. Justification of the 
program to all key stakeholders and sponsors helps in the 
successful execution, implementation and completion of the 
program. The program business case should provide eco- 
nomic justification for the change journey and for each 
program within tlie change journey. The program business 
case generally explains why the sponsoring organization 
should change, what value it receives by changing, and what 
steps are necessary for a successftil change. The program 
business case addresses tliree main components, including 
business context and change imperatives, value impact 
analysis, and change journey. Tlie tasks in the justification of 
the program in step are generally illustrated in FIG. 4B. 

[0107] Referring to FIG. 4B, the organization first deter- 
mines an economic evaluation approach, step 411, to obtain 
a "buy in" from the appropriate stakeholders in the spon- 
soring organization on the overall implementation approach 
for the program. Specifically, the organization tries to dem- 
onstrate tlie tangible benefits of a program to the affected 
parties. Step 411 attempts to show the process of imple- 
menting the program as an investment with positive, long- 
temi benefits. 

[0108] Returning to FIG. 4B, the next task in step 410 is 
to create a model structure, step 412. In step 412, the 
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organization obtains internal agreement regarding the struc- 
ture of tlie model used to determine the benefits of imple- 
menting the program. For example, benefits to be derived 
may be expressed in terms of increased market share or 
reduced operating costs. In tliis way, affected parties may 
communicate the program's effects in terms of similar 
measures of costs and benefits. As suggested in FIG. 4B, the 
organization may also attempt to justify the program by 
forecasting baseline business performance, step 413. In 
other words, the organization may attempt to determine how 
the organization and its comprising units would perform 
without implementing the program. Continuing with FIG. 
4B, another task in step 410 is to project net change Journey 
benefits, step 414. The organization performs step 414 to 
predict and quantify the benefits that will be derived from 
implementing the program. 

[0109] The next step in step 410 is to assemble a business 
case, step 415, using the results assembled during steps 
411-14. The organization may perform step 415 to document 
rationale for implementing the program. Ultimately, tliis 
documentation may serve as a motivational tool for change 
witliin the organization. 

[0110] Returning to FIG. 4A, the next task in the program 
management stage 400 is to plan the program execution, step 
420. During step 420, the organization develops plans for the 
program itself, financial management and resoiu-ce manage- 
ment. Program approaches are referenced during tlie cre- 
ation of these documents. These plans guide the continued 
implementation of the program and are what the program 
will monitor itself against during later tasks. Tlie individual 
tasks of step 420 are illustrated in FIG. 4C. In step 420, the 
organization may develop a consolidated program plan, 
which dociunents the necessary tasks, effort, schedule, and 
costs for all releases of a business capability. Tlie organiza- 
tion may also refine a program statement of work, and 
develop bottom-up project plans. Subsequently, the organi- 
zation reconciles these plans with the top-down plans to 
generate a program baseline. The organization may liave 
performed step 420 initially during program plarming, in 
conjimction witli or prior to the analysis stage 700 described 
below. Then, step 420 may be reinitiated during tlie course 
of tlie program as replanning is required by program man- 
agement. 

[0111] Looking at FIG. 4C, the first task of the plan 
program execution in step 420 is to plan program processes, 
step 422. The organization may specifically determine all the 
management processes necessary to support the program. 
These relate to resources, vendors, quality, configuration, 
releases, issues, problems, risk, finances, contingency, and 
performance reporting. The organization may estabhsh and 
document goals and metrics for each management process. 
The organization should begin this task package at the start 
of the program, and refine the management processes as the 
program progresses. The organization may perform tliis 
initial planning at the program level to help ensure that there 
are no gaps or overiaps of activities. Wliile all the activities 
within the Delivering phase may be required for a particular 
business capability, it is unlikely that all of the activities 
should fall within the scope of a single project team. If the 
initial distribution of the activities to project type is done at 
the program level, the risk of missing or duplicate activities 
is limited. 



[0112] Returning to FIG. 4C, the next step in the plan 
program execution, step 420, is to develop a program 
budget, step 424, In step 424, the organization may establish 
a program budget tliat augments the cost baseline estab- 
lished in the program plan. The program budget provides ihe 
additional information needed by program management to 
manage the day-to-day financial affairs of tlie program. 
[0113] Another step in the plan program execution, step 
420, is to develop a program conmiunications plan, step 426, 
as illustrated in FIG. 4C. In step 426, the organization may 
identify and plan messages to program personnel, key pro- 
gram executives, and other stakeholders in the program. In 
that way, step 426 addresses the communication needs 
witliin the program teams. 

[0114] Subsequently, the organization performs the task of 
finalizing the program plan, step 428, as depicted in FIG. 
4C. In step 428, the organization may assemble the com- 
posite program plan. The Program Plan compiles the outputs 
from the plan management process 422 with the develop- 
ment of a program plan in step 424. The organization may 
then obtain executive and other appropriate management 
understandmg and approval of tlie folly elaborated program 
plan and its components. Tlie organization further briefs all 
key stakeholders (i.e., executive management, and impacted 
business operations) to eusiu-e their understanding of, and 
commitment to, the program plan. Tliis is crucial, because 
following tliis task: (1) the program should be described to 
the organization, and (2) more personnel should be assigned 
to the program. The organization may then take this oppor- 
tunity to resolve any unclear or incorrect stakeholder expec- 

[0115] Returning to FIG. 4A, the next slop of the program 
management 400 is to organize program resources, step 430. 
During the step 430, resource requiremeiils ;ire ;iiialy/.ed and 
aligned so as to meet program objectives. As the program 
determines its resource needs, tlie Program Resource 
Request is completed to obtain the resources. Oiganize 
Program Resources is linked closely to plaiming the pro- 
gram's execution and pertains to staiBng of the overall 
program. Under the Plan Program Execution task, the Pro- 
gram will plan for and deal witli resource questions related 
to subordinate projects. Specifically, the organization may 
generally analyze resource requirements, initiate the pro- 
curement of goods and services, obtain human and physical 
resources from participating entities, assign these resources 
to projects, and release the resources upon project comple- 
tion. The organization may perform step 430 tlirougliout the 
life of tlie program created and implemented in step 400. 

[0116] As illustrated in FIG. 4D, in order to obtain and 
deploy resources, tlie organization may analyze resource 
requirements, step 432. Tliis task analyzes resource require- 
ments as defined in a program management resource plan. 
Resource requirements are consolidated from project needs 
and should generally include desired resource provider 
(generally tlie organization itself), if previously determined, 
resource skill/type, and time period (such as montUy). 
Continuing with step 432, the organization may create a 
program resource management plan that forecasts resource 
needs by stage and capability release. 

[0117] Retimiing to FIG. 4D, the organization may further 
obtain and deploy human resources, step 434. Human 
resources are obtained by initiating a request witli the 
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Human Resources Organization, interviewing potential can- 
didates, and selecting the candidate that best fits the require- 
ments. Human resources are then assigned to projects as 
they arrive at the program. This task, alternatively, may be 
assigned to the projects. The program resource management 
plan may reflect actual information regarding the resource 

[0118] Returning to FIG. 4D, the organization may also 
procure and deploy physical resources, step 436. Physical 
resources are generally procured by initiating a resource 
request, evaluating the potential resources, and selecting the 
resource tliat best fits the requirements. Resources are then 
assigned to projects as Ihey arrive at the program. The 
Physical .A.ssets hwentory and the Program Resource Man- 
agement Approach arc generally both updated to reflect 
actual infonnation regarding the resource request. 
[0119] Referring again to FIG. 4D, the organization also 
releases resources, step 438. When human resources are 
assigned to projects, they receive a "roll-ofP' date indicating 
when these human resources are eligible for reassignment 
within or outside the program. If not reassigned inside the 
program, human resources are released to appropriate 
human resources departments for reassignment. Similarly, 
physical resource utilization is scheduled by each project, 
and these resources are reUirned upon completion of use. 
This process generally coincides with tlie completion of 
each stage of work. Al that point, a determination should be 
made whether to retain or release the human and physical 
resources Irom the program. Al this point in process 430, the 
entire process 430 may repeat if there are more program 
resources to organize, decision 439. 
[0120] FIGS. 4A and 4E illustrate another step in tlie 
program management process, the control of program, step 
440. k> step 440, program management monitors program 
performance agamst program plans. Deviations fi-om the 
plan are monitored. Corrective action is taken to resolve 
deviations as necessary. Program plans are updated to reflect 
modifications to the program. Step 440 generally provides 
leadership to guide the planning and execution of program 
work. In step 440, the organization may maintain key 
working relationships within the program, wliile monitoring 
and developing the skills and performance of program 
management team members. The organization may fiirther 
identify and assess problems with program performance, 
and specify corrective actions as needed. The oiganization 
may evaluate program metrics to determine progress toward 
program objectives, and to determine whether or not the 
ciurent metrics are still relevant. The organization may 
further assess whether or not the program is on track by 
reviewing program, project, and vendor performance. 
[0121] The first task of step 440 is to administer the 
program, step 441 as illustrated in FIG. 4E. An effective 
program administration results in a plamied, organized, and 
managed program management office perfonning a wide 
range of cost-effective activities. As required, the teamwork 
environment requirements Mst deliverable should be updated 
to reflect relevant changes in the program. Program leaders 
should also strive to maintain a culture that encourages 
program participants to acliieve maximum results. Program 
leaders should also conmiunicate the common program 
vision to inspire others to support program goals. 
[0122] A second task in step 440 is to report performance, 
step 442, as illustrated in FIG. 4E. The organization may 



process and prepare reports for cost/schedule and other 
performance data (e.g., quality, risk, resource, etc.). This 
should involve a standard set of reports as defined in the 
program performance reporting approach section of the 
program plan. Any ad hoc reports requested by program 
management may also be prepared. 

[0123] Returning to FIG. 4E, another task in step 440 is 
to perform financial management, step 443. Specifically, the 
organization may report, monitor, and account for the pro- 
gram's financial performance and results by performing the 
financial management fmictions as specified in the Program 
Financial Management Approach section of the Program 
Plan. Similarly, in step 444, tlie maintenance of administra- 
tive policies and standards, the organization may update and 
refine the administrative policies and standards on the basis 
of their effectiveness and die evolving needs of the program, 
as illustrated in FIG. 4E. The organization should further 
communicate the changes to the program team members. 

[0124] Returning to FIG. 4E, tlie next task in step 440 is 
to conduct, as necessary, ongoing program orientation and 
training, step 445. In step 445, the organization may conduct 
periodic orientation and training sessions as new members 
join the program, as new types of training are required, and 
as team members need additional career development oppor- 
timities. Likewise, in step 446, the organization monitors a 
program communications plan to help to ensure that the 
appropriate groups accomplish their responsibilities. The 
program management office itself may also be responsible 
for perfonning some of the activities as directed in the 
program commiuiications plan. 

[0125] In another group of steps illustrated in FIG. 4F, the 
organization may complete the program, step 450. hi step 
450, a program closeout report is prepared along witli other 
program closeout documentation. The program is demobi- 
lized and responsibility for the program is transferred to the 
necessary parties. The organization acliieves an orderly and 
successful program closure by formally transferring respon- 
sibility for the solution components to the operational units, 
obtaining foniial management acceptance of the competitive 
solutions delivered, releasing the remaining human and 
physical resources to their providing organizations/owners, 
and completuig a disposition of all program documentation 
and otlier materials. 

[0126] As illustrated in FIG. 4F, one step in the complet- 
ing the product is to complete documentation, step 452. The 
activities needed to complete all program documentation 
include preparing any final documentation needed to close 
the program, inchiding final cost, perfomiaiice reports, etc. 
Additionally, a final review of the documentation is per- 
formed in step 452 to ensure that it is complete and conforms 
to program standards. The organization should also identify 
materials that should be shared across tlie organization, 
especially process improvements, methodologies, tech- 
niques, estimating models, and reusable components. The 
organization should also take steps to ensure that the mate- 
rials are included in the appropriate repositories. The pro- 
gram documentation and other materials are transferred to 
any appropriate locations. Key deliverables are sent to the 
software engineering process group team, as determined. A 
summary of the program's final disposition, assets, records, 
and other appropriate, relevant information should be con- 
tained in the program closeout report deliverable. 
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[0127] Continuing with FIG. 4F, another step in the 
completion of the product is to transfer program responsi- 
bility, step 454. This activity transfers responsibility for the 
business capability to tlie appropriate organizational unit(s). 
Responsibility is assumed by the organizational units 
responsible for the continuing operation, maintenance, and 
use of the business capability and its underlying compo- 

[0128] Returning to FIG. 4F, another step in the comple- 
tion of the product is to demobilize the program, step 456. 
Tlie resources to be released include the remaining program 
participants and all facilities (including furniture and equip- 
ment). The hmnan resources are reuimed to the organiza- 
tional imits tliat provided them. The physical resources are 
released or returned to their owners. Any remaining pro- 
curement agreements (purchase orders, contracts, leases, 
rental agreements, etc.) are closed out. 
Project Management 

[0129] Returning to FIG. 1, the CMM in a BOX method 
10 generally calls for the oxganizations to concurrently 
perform project management 500 with the program man- 
agement 400. The project management 500 is generally 
depicted in FIGS. 5A-50. Project management 500 gener- 
ally concerns activities and structures directly related to the 
creation and refinement of a project or product for sale. 
Project management 500 controls the delivery of the specific 
components from which a business solution is derived 
through the balanced management of Scope, Quality, Effort, 
Risk and Timeline (SQERT). Project management 500 
focuses on making critical decisions and managing risk that 
will ensure the delivery of the promised scope, on time and 
within budget al the agreed-upon levels of quality. When a 
program management function exists, project management 
works closely with program management to execute the 
SQERT activities in relation to the delivery of multiple 
projects mider one overall program. As illustrated in FIG. 
5A, project management 500 generally includes planning of 
project execution (step 510); organization of project 
resources (step 520); control project work (step 530); 
completion of the project (step 540); an SQA review execu- 
tion (step 550); and supplier agreement management (step 
560). 

[0130] FIG. 5B presents the individual tasks required in 
the platuing of project execution, step 510. The organization 
may perform this task package 510 at project initiation to 
define pieces of the initial Project Plan and subordinate plans 

that should be used to manage the execution of the project, 
■file tasks associated with Plan Project Execution, such as 
planning and estimating, are performed tlirouglioiit the 
project lifecycle at predefined decision points, and whenever 
replaiining is required. During the plaiming of project execu- 
tion in step 510, the organization may tailor the process, step 
512, to suit a project's needs by using blown tools or means. 
The organization may further request a waiver for any 
required steps that should not be followed on the particular 

[0131] The organization may further implement the plan- 
ning of project execution, step 510 tlirough the development 
of a project plan, step 514, as illustrated in FIG. 5B. The 
organization may perform this task using a template to 
customize a specific project. The project plan describes tlie 
project approach for the project timetable, metrics, organi- 



zation, supplier agreement management, communication 
and sponsorship strategy, training, quality initiatives, soft- 
ware system development process, configuration manage- 
ment, logistics, facilities, tools, and purchasing. Tlie project 
plan also describes the project approach for training, metrics 
tracking, and roles and responsibilities on the project. The 
organization may fiirther use a best practices matrix, a 
metrics plan, a DAR reference document, and a training 
needs matrix to develop the project plan, as defined in the 
CMMI. The DAR reference document describes the formal 
DAR process and provides guidelines for identifying DAR 
triggers, setting thresholds, and selecting the best tech- 
niques. This information should be used to complete the 
quality program section of the project plan. The metrics plan 
generally contains the list of required and recommended 
metrics that a project should include in the project plan. 
[0132] The planning of project execution, step 510, con- 
tinues in FIG. 5B with the development of subordinate 
plans, step 516. In step 516, the organization may develop 
the appropriate subordinate plans to satisfy the needs of the 
project. For instance, the organization may define, as 
needed, subordinate plans for subcontractor management, 
risk management, communication and sponsorship, and con- 
figuration management. All projects require the creation of 
a work plan, and an organization may create a bottom-up or 
task-level project work plan based upon estimates. Critical 
paths and dependencies are defined and managed within the 
project work-plaiming tool, such as the Microsoft Project 
and Project Workbench®. 

[0133] Returning to FIG. 5B, the next step in plan project 
execution 510 is to develop project estimates, step 518. The 
development of project estimates in step 518 is analogous to 
the development of project estimates in step 218, as 
described above in FIG. 2B. Specifically, tlie organization 
may develop project estimates, step 518, using an estimating 
tool as a starting point for the estimates. For instance, 
estimates may be developed using the following steps: (1) 
tailor tasks and estimating model; (2) determine estimating 
factor values; (3) define work packages; (4) determine a 
timeline for the estimate; (5) reconcile a present estmiate to 
an initial estimate; and (6) document assumptions used to 
form the estimates. The organization preferably further 
validates any estimates by verilying estimates against esti- 
mates or actual results from comparable projects. To fomi 
accurate estimates of available resources, the organization 
should fiuther consider other resource-tapping activities, 
such as community involvement, recruiting, mentoring, and 
training, when evaluating resources. 

[0134] Another step of the project management 500 is to 
organize project resources, step 520, as illustrated in FIG. 
5C. The orgajiizing of project resources in step 520, as well 
as in substeps 521-25, are analogous to steps 220-25, 
described above in FIG. 2C. Tlie organization can perfonn 
these tasks as needed to organize the project's human 
resources, establish other resources, to inake work assign- 
ments, and to develop training enabling resources. In step 
520, the project focuses on obtaining, assigning and training 
its human resources and establishing the project's other 
resources. This task is perfoniied iterarively as needed to 
organize, mobilize and manage project resources tliroughout 
the execution of the project. 

[0135] Turning to FIG. 5C, the first step in organizing the 
project resources in step 520 is to refine resource needs, .step 
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521. In this step 521, the organization defines the team 
organization structure, schedules the work, and defines tlie 
human and physical resource needs of the project. These 
tasks are performed in view of each project's requirements. 
By refming resource needs in step 521, the organization 
helps to ensure that project stafSng and facilities needs are 
met on a timely basis without affecting the completion date 
and the quality of the work. The organization may complete 
this refining of resource needs in step 521 by (1 ) determining 
project organization structure; (2) balancing a development 
schedule using human resource guidelines; and (3) refining 
physical resource needs that were outlined in the logistics, 
facilities, and tools section of the project plan formed in step 
210. 

[0136] Returning to FIG. 5C, the oiganization continues 
the organization of the process resources in step 520 by 
establishing project standards and goals, step 522. The 
establishment of project standards and goals in step 522 is 
accomplished by developing, modifying, and adopting 
administrative and project-specific project standards and 
procedures. Examples of administrative procedures are 
employee availability checklists, time accounting proce- 
dures, status reporting, vacation scheduling, etc. Project 
standards and procedures include design and development 
standards, and the use of project-specific tools. The estab- 
hshment of these standards and procedures preferably 
improves the organization's communication, operating eflS- 
ciency, and overall control of the project. 

[0137] Tlie organization continues tlie step of organizing 
the process resources, step 520, dirougli organizing a project 
team in step 523, as also illustrated in FIG. SC. The 
selection of project team members is based on project 
requirements. Otlier elements in the organization of a project 
team are the finalization of the project team's organization 
structure and documentation in the organization chart of the 
project plan. The organization should flirther update a train- 
ing needs matrix to document (1) the training required of 
each project team member and (2) the proposed means for 
fulfilling the training. Tliis document is used to track project 
team member training. In anotlier implementation, organiz- 
ing a project team in step 523 iiirther requires tlie organi- 
zation to determine, as a team, die project's mission, vision, 
and charter, and then to document these detenninations in a 
project plan and orientation bmder that is created as required 
for the CMM. 

[0138] Returning to FIG. 5C, another task in the organi- 
zation of project resources in step 520 is to estabhsh other 
resources, step 524. Specifically, the organization performs 
this task to organize die physical resources, such as hard- 
ware or software, provided by program management and to 
develop the orientation and/or training needed to support the 
activities of the project team. The establisliment of other 
resources in step 524 helps create a work enviromnent that 
promotes communication, collaboration, and group cohe- 

[0139] -Also as illustrated in FIG. 5C, the organization of 
project resources in process 520 fiirther includes enabling 
resources, step 525. Oi^anizations perfomt this step to orient 
and train team members, manage the physical resources 
assigned to the project, and coach and evaluate team mem- 
bers. The enabling of resources in step 525 aids the project 
manager in motivating and cliallenging team members and 



while helping to ensure that various project personnel 
believe their work to be important. Specifically, tlie organi- 
zation should communicate the project's mission, vision, 
and cliarter to new team members. Large projects may also 
elect to fonnahze these items at the program level, and 
projects may conduct one or more meetings that include all 
team workers. 

[0140] As illustrated in FIG. 5D, another step in the 
project management 500 is to control project work, step 530. 
In step 530, project management monitors the execution of 
the project agauist project plans and makes adjustments as 
necessary. Project Status Reports are prepared for the Project 
Sponsor. Potential and acftial problems are identified 
through the measuring and monitoring of progress and 
perfonnance against the Project Plan. Depending on tlie type 
of problem identified, an Issue, Risk, SIR or CR is logged. 
Project management is expected to take appropriate correc- 
tive actions to resolve problems that are discovered. Step 
530 and consiitutmg tasks 531-37 closely correlate, respec- 
tively, to steps 230-37, described in FIG. 2D and its accom- 
panying text. Tlie organization performs step 530 to control 
project execution tliroughout the project's life cycle. The 
control oi project work in step 530 includes identifying 
potential and actual problems by monitoring and measuring 
progress against the project plan. 

[0141] As illustrated in FIG. 5D, the controlling of project 
work in step 530 begins with the releasing of work packages, 
step 531. To release work packages, the orgajiization should 
assemble and release work packages according to the work 
plan, and conmranicate their requirements to the assigned 
team members. Work packages are generally described in 
the CMM cnteria and generally relate to tlie task and 
limclioiis given to the various workers in a project. Tlie 
project team then performs the work needed to develop the 
required deliverable good. During step 531, the organization 
preferably acts to ensure that each team member understands 
assigned responsibilities, including target dates and budgets. 
Furthemiore, the organization should encourage each team 
member to provide input regarding various assigned respon- 
sibilities, including target dates and budgets, and to accept 
and carry out these assigned responsibilities. 

[0142] As depicted in FIG. 5D, a following step in the 
control project work, step 530, is measuring perfomiance, 
step 532. The measuring of performance in step 532 gener- 
ally includes capturing actual results and calculation of 
metrics in order to manage performance. Capture metrics, as 
outlined in the organization metrics plan formed in step 510, 
include cost, effort, scope, quality, and schedule. The orga- 
nization should further track project infrastnicture/technical 
requirements, such as hardware, software, and performance 
requirements, that were outlined during planning in step 
510. Tlie organization should also analyze any deviations 
from the project plan and identify, in a timely manner, the 
causes for the deviations. 

[0143] Concurrent with the measuring of performance in 
step 5.32 is managing performance, step 533, as illustrated in 
FIG. 5D. Managing performance in step 533 generally 
requires the organization to manage project perfonnance 
against the previously defined project and work plans. To 
project performance in view of the project and work plans, 
the organization proactively assesses performance, status, 
quality, and risk. When the actual results from the develop- 
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ment of the project do not match the plans, the organization 
should further deternune alternative goals or actions. The 
implementing organization may hirther obtain approval for 
corrective actions, and then take corrective actions. The 
corrective actions may include, but are not limited to, work 
process changes, team building, training, increased or 
decreased supervision, work assignment changes, reassign- 
ment of team members, initiation of risk responses, the 
change of requests to be pursued with program management 
as part of the configuration management process, project 
replamiing changes that specify needed modifications to tlie 
project plan, project plan revisions (work package changes, 
etc.) or escalation to program management. The organiza- 
tion should also reevaluate project decisions througiiout the 
project life cycle, when project triggers or other issues, risks, 
etc. arise. In step 533, the organization may also manage 
team member performance according to organizational stan- 
dards and tools. 

[0144] Continuing with FIG. 5D, following the measuring 
of performance in step 532 and the managmg of perfor- 
mance in step 533, tlie organization communicates project 
status, step 534. During the step 534, the organization 
generally develops and communicates project status to all 
project stakeholders according to the Project Plan. The 
project stakeliolders include project and senior management 
and other affected groups. The organization fiirther conducts 
status and review meetings involving affected groups as 
appropriate. During the communication of project status in 
step 534, the organization should document meeting minutes 
as required for the CMM. 

[0145] Continuing with FIG. 5D, following the couunu- 
nication of project status in step 534, the orgamz;ition 
obtains acceptance of interim deliverable goods, step 535. 
Obtaining acceptance of interim deliverable goods in step 
535 generally requires that the organization oblam accep- 
tance of interim deliverables by all designated stakeholders, 
as appropriate, at key interim points tliroughout tiie project 
life cycle. Any acceptance of final deliverables takes place 
in connection with completing the program. 

[0146] Another task in the control of project work in step 
530 is to execute project management processes, step 536. 
The organization should execute these processes in conjunc- 
tion with other project control activities, such as measure- 
ment activities and status reporting. Also, the project man- 
agement processes may occur continuously, periodically, or 
may be event driven. One project management process in 
step 536 is risk management, wliich addresses the identifi- 
cation, analysis, and avoidance/mitigation aspects of risk 
management on a project. One project management process 
is risk identification, during which the organization identi- 
fies, names, and describes the various risks. Tlie organiza- 
tion should further generate a list of specific incremental 
risks in the project's risk-tracking tool. The organization 
documents known triggers for a risk, the potential damage 
for each risk item, and references for the sources of risk. 
Another risk management task in step 536 is risk analysis, 
in which the organization analyzes the identified risks. In 
risk analysis, the organization should classify tlie risks and 
include any additional information necessary to support the 
analysis. The organization may then select a rank/prioritized 
list of top risks. For instance, tlie organization may create a 
list of the top five risks to a project. Another risk manage- 
ment task is risk avoidance and mitigation. Risk avoidance 



activities address the sources of a risk, thereby reducing the 
probability that it should become a problem. For a top- 
ranked/prioritized risk, the organization should identify how 
the risk can be avoided. Risk mitigation measures attack the 
consequences of a risk, reducing the risk's potential impact 
on tlie project. For the top-ranked/prioritized risks, the 
organization may identify actions to reduce the impact of the 
risk if it occurs. The organization may also use DAR to 
assess the risks. 

[0147] Another project management process in the execu- 
tion of project management processes in step 536 is scope 
management, which addresses the acceptance of require- 
ments to define scope and the requirements of change 
control process. For instance, one scope management task is 
requirements development. During the task of requirements 
development, the organization identifies and documents 
requirements needed to promote and ensure bi-du-ectional 
traceability, so tliat the organization may trace requirements 
between the development and the testing of the require- 
ments. As with all work products, requirements are prefer- 
ably placed imder configuration management (CM), as 
defined in the CMMI. Anotlier scope management task is 
requirements acceptance, during which the organization 
documents and reviews requirements with all affected 
groups and obtains acceptance from the affected stakehold- 
ers. The organization should fiirther establish baseline stan- 
dards for satisfying the requirements. -%iother scope man- 
agement task for the organization is to make any required 
changes to the requirements and their baselines. The orga- 
nization generally follows the project's change control pro- 
cess for any changes to baselined requirements. Specifically, 
the organization submits a change request; reviews a change 
request; perfomis impact analysis, including cost, schedule, 
and efforts impacts; determines disposition; implements 
change, including associated impact to other work products 
and activities; and notifies requester and affected groups. 
Again, ihe organization may determine if it is necessary to 
use D.^R to assess changes in scope. 
[0148] Another project management process in step 536 in 
the execution of the project management processes is con- 
figuration management. This task addresses the set of activi- 
ties perfoniied to establish and maintain the integrity of the 
project work products throughout the project's life cycle. 
One set of configuration management tasks relates to con- 
figuration identification activities. During tlie configuration 
identification activities, the organization identifies, names, 
and describes each of the configuration items that should be 
placed under configuration management. In particular, all 
work products should be placed under some type of con- 
figuration nianagement. During the configuration identifica- 
tion activities, the organization generally uses tlie CM plan 
to define a baseline for the configuration items and to 
indicate the level of configuration management for each 
item. Another configuration management process in step 536 
is configuration of control activities. Generally, the organi- 
zation requests, evaluates, approves or disapproves, and 
implements changes to the baselined configuration items 
defined during the configuration identification activities. All 
of the configuration items should be archived and placed 
under the project's documented cliange control process. 
Configuration of status accounting activities is another con- 
figuration management process in step 536. During this 
process, the organization records and reports the status of the 
project's configuration items using a configuration manage- 
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ment status report. Similarly, the organization should further 
perform configuration audits. Specifically, the organization 
may, using the CM plan, determine the extent to which 
actual configuration items reflect the plamied configuration 
items. The purpose of this task is to ensure that the entire 
configuration is correct and complete. The organization 
should further document results as required in the CMMI, 
using a configuration audit. 

[0149] Anotlier project management process of tlie execu- 
tion of the project management process in step 536 is issue 
management and escalation. Tliis task involves the identi- 
fication and documentation of issues using an issue tracking 
tool, as well as a review of the issue and an analysis of any 
mipact on deliverables, scope, contingency, resources, costs, 
schedule, and/or quality. Specifically, the organization 
should identify a resolution approval party, an issue's owner, 
and determine expected time frames. The organization may 
also determine if it is necessary to use DAR to assess the 
issue, as described above. The organization may fiirther 
research and identify issue solution alternatives. Subse- 
quently, the organization may refer the issue to program/ 
senior management when: (1) the project manager cannot 
resolve tlie issue internally, (2) when the issue impedes the 
progress of a project, and when the issue is beyond the 
authority of the project manager to resolve. These are 
generally issues that (1) cajinot be resolved witliin a project 
team, (2) are resolvable with action items, (3) can be 
escalated to the next level, (4) arc rcactivcly discovered 
during the course of development, (5) aifect program/'prqject 
scope, costs, schedule, projected business perfomiance, or 
high-level design, (6) affect multiple projects or releases, 
and/or (7) involve groups outside the project that affect 
project delivery. The organization should accordingly moni- 
tor issues status while approving or rejecting resolutions. At 
the same time, the organization should coninuinicate reso- 
lutions to stakeholders and afiected parties and take correc- 
tive action as described above in the context related to 
management of performance tasks. 

[0150] Returning to FIG. 5D, another step during the 
process of controlling the project work in step 530 is to 
update the project plan and subordinate plans, step 537. In 
particular, diroughout the life cycle of the project, the project 
plan and subordinate plans (Risk Management, Configura- 
tion Management, Work Plan, Subcontractor Management 
Plan, Community, and Sponsorship Plan) should be updated 
as appropriate, by the organization to reflect any clianges on 
the project that should affect the content of the documenta- 

[0151] Anotlier step of project management 500 is to 
complete tlie project, step 540, as illustrated in FIG. 5E. In 
step 540, project closeout is performed and overall project 
results are evaluated. Project Management verifies that all 
activities for a project are complete so that all resources can 
be released and all documentation and responsibilities can 
be transferred to the necessary parlies. In this way, step 540 
enables Project Management and the Project Sponsor to 
measure the success of the project and use results of the 
project as inputs to fiiture efforts. A first step in completing 
the project in step 540 is to obtain a formal acceptance of 
deliverable(s), step 541, and this task 541 entails obtaining 
sign-offs on the final deliverables from the appropriate 
stakeholders. In effect, each stakeholder should agree that 
tlie project is, in fact, complete. Another step in completing 



the project during step 540 is the preparation of final 
documentation, step 542, in which the organization com- 
pletes final revisions and packaging of deliverables. Like- 
wise, the organization furthers the completion of the project 
in step 540 by transferring responsibility for deliverables, 
step 543, to formally transition responsibility for the deliv- 
erables to the appropriate parties. The transfer of responsi- 
bility for deliverables in step 543 generally includes the 
transition of training materials, operations manuals, and 
other supporting documents. 

[0152] Continuing witli the completion of the project in 
step 540, the organization evaluates the project, in step 544, 
by assessing the success of the project, summarizing the 
project's accomplisliments, discussing/documenting any 
items for improvement, and channeliag the resulting infor- 
mation through the appropriate quality management process. 
The various results of the evaluation of the projects in step 
544 should be recorded in a closing memo, as specified in 
the CMMI. The results of the evaluation may include (1) 
reviewing the project work plan; (2) updating the estimates; 
(3) sending the project's actual results to the owners of the 
estunating tool; (4) submitting final project metrics to the 
Software Engineering Process Group (SEPG); and (5) con- 
ducting an SQA debriefing to discuss results of the SQA 
program and also process improvement points. .Another step 
m the completion of the project, step 540, is to release 
resources, step 545. The organization performs step 545, for 
instance, to "roll off" human resources from the project and 
to return equipment and supplies to the appropriate custo- 
dian, thereby fi-eeing these resources for use on other 
projects. 

[0153] Returning to FIG. 5A, the next task in the project 
management 500 is software quality assurance (SQA) 
review exeaition, step 550, the substeps of wliich are 
illustrated in FIG. 5F. During the SQA review execution of 
step 550, the organization may conduct software process and 
work product quality assurance reviews to verify project 
adlierence to standards and procedures. The first step of the 
SQA review execution 550 is to complete a project plan and 
metrics workbook, step 551. In this way, the project manager 
and SEPG liaison are encouraged and required to identify 
deliverables and processes to be reviewed; ensure that 
deliverables in the Project Plan and Work Plan are consis- 
tent; identify reviewers, reviewees, and review criteria; 
identify roles and responsibilities; identify SQA metrics; 
complete the quality program section of tlie project plan; and 
update Ihe metrics workbook widi the SQA review schedule. 

[0154] Another step of the SQAreview execution 550 is to 
prepare for an SQA review, step 552. In the SQA review, the 
project manager provides job accounting information to the 
SQA reviewer and sets SQA review expectations. In prepa- 
ration for the SQA review during step 552, a deliverable 
owner (i.e., a party responsible for producing a deliverable 
product or service) provides the deliverable to be reviewed, 
where "deliverable" is defined in the CMMI. The deliverable 
owner fiirther provides contact and availability information 
to the SQA reviewer and provides review criteria and 
standards to the SQA reviewer. In response, the SQA 
reviewer gathers the deliverable product or service, reviews 
the proposed review criteria and standards, schedules a 
meeting with the deliverable owner, and receives job 
accounting information fi-om the project manager. 
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[0155] Returning to FIG. 5F, another step of tlie SQA 
review execution 550 is to coniduct the SQA review, step 
553. During the SQA review in step 553, the SQA reviewer 
generally reviews deliverables against review criteria/stan- 
dards, identifies nonconformance items, and follows up with 
the deliverable owner as needed to meet the requirements of 
the CMIVO. At the same time, a SEPG liaison reviews the 
project maoagement deliverables against a best practices 
matrix. For the CMMI, the deliverable owner should be able 
to continue answering any questions. 

[0156] .Ajiother step of the SQA review execution 550 
illustrated in FIG. 5F is to prepare the SQA report, step 554. 
The SQA reviewer prepares a detailed sununary of findings 
and recommendations, including item number, date 
reported, and an accurate description of nonconformance 
items. The SQ.A reviewer then distributes the SQA report to 
the deliverable owner and tlie SEPG liaison. The deliverable 
owner should then document responses in the SQA report 
template. 

[0157] Continuing witli FIG. 5F, another step of the SQA 
review execution 550 is to discuss nonconfonnance items, 
step 555. Specifically, the organization should require the 
deliverable owner to discuss any nonconfonnance items 
with the SQA reviewer. In addition, the deliverable owner 
updates the SQA Report with proposed resolution(s) and 
projected completion date(s) for agreed upon items. The 
deliverable owner also escalates disagreement items for 
facilitation and updates a return report, as well as any 
necessary documents to tlie SQA reviewer for verification. 
In response, the SQA reviewer should discuss nonconfor- 
mance items witli the deliverable owner and verily the 
resolution of nonconformance items. During step 555, the 
SEPG liaison and the project management should also 
resolve escalated nonconfonnance items and resolve, on a 
case-by-case basis, any issues that may arise due to sched- 
uling conflicts between Ihe SQA reviewers and the deliver- 
able owners. 

[0158] Continuing with FIG. 5F, another step of the SQ.A 
review execution 550 is to track SQA metrics, step 556. in 
step 556, the SQA reviewer sends the final report to the 
deliverable owner and the SEPG liaison. At this point, the 
SEPG liaison may update an SQA tracking tool and forward 
tlie final report and metrics to the project sponsor and project 
manager Typically, the SEPG liaison includes metrics such 
as the SQA schedule variance; the number of nonconfor- 
mance items; the cost/savings of the SQA program; the 
value added by conducting SQA reviews; and a best prac- 
tices percentage showing compliance with desired best 
practice policies. As required by tlie CMMI, the project 
manager keeps copies of documentation and reports. 

[0159] Anotlier aspect in the project management 500 is 
supplier agreement management, step 560, which is gener- 
ally illustrated in FIG. 5G. The supplier agreement man- 
agement 560 comprises subconlraclor management in step 
560(a) and product acquisition in step 560(6). Specifically, 
the subcontractor management in step 560(a) comprises the 
tasks of plaiming subcontractor management, step 561; 
organizing subcontractor management resources, step 562; 
controlling subcontractor management, step 563; and com- 
pleting sutjcontractor management, step 564, as illustrated in 
FIG. 5G. Likewise, product acquisition in step 560(6) 
comprises the tasks of plamiing product acquisition, step 



565; organizing product acquisition, step 566; controlling 
product acquisition, step 567; and completing product acqui- 
sition, step 568, as depicted in FIG. 5G. 

[0160] FIG. 5H depicts that tasks 561(a)-561(/) comprise 
the planning of subcontractor management in step 561. In 
step 561, project management plans for the project's use of 
subcontractors including developing criteria to be used for 
subcontractor selection. The first task in step 561 is to 
identify the need for a subcontractor, step 561(a). In step 
561(a), the organization identifies a need for a subcontractor. 
Before the need for a subcontractor is detennined, the 
business requirements for the project should be defined. The 
objective is to describe "what needs to be done and/or 
achieved" and which development teatnys should be instru- 
mental in implementing this requirement. The supporting 
analysis and research provide input with regard to the 
requirements, including the current capability analysis, con- 
straint analysis, best practice research, and potential delivery 
options. If the project team does not have the resources to 
satisfy these requirements, then a subcontractor should be 
considered. Again, the organization may use DAR if nec- 
essary to evaluate the need for a subcontractor. If a subcon- 
tractor is needed, the organization should update the supplier 
agreement management section of the project plan with a 
description of the subcontractor arrangement. The organi- 
zation may then prepare the subcontractor management 
plan. 

[0161] Returning to FIG. 511, the organization's next 
action during the planning of subcontractor management in 
step 561 is to define a subcontractor statement of work 
(SOW), step 561(6). 'nie subcontractor SOW should clearly 
define the scope and objectives of the subcontract, the 
process that should be used to manage the subcontractor, and 
any standard contract clauses. The SOW should also provide 
as much detail as possible about the plaimed subcontract, 
including the contract monitoring process, the quality man- 
agement process, the configuration management process, 
and the contract closure process. A proposal/project team is 
generally responsible for identifying tlie teclinical require- 
ments that the subcontractor should satisfy. 

[0162] As depicted in FIG. 5H, the organization's next 
action during the plamiing of subcontractor management in 
step 561 is to develop subcontractor selection criteria, step 
561(c). Prior to assessing subcontractors, the organization 
should define the selection criteria. Whereas some criteria 
should be generic, such as quality, service, value, and past 
performance, there is greater value in defining specific 
criteria that apply to diflferent categories of assets and 
services to be procured, especially those criteria concerning 
longer-term cost considerations. Selection criteria should 
also reflect defined business needs. To satisfy this step 
561(c), the proposal/project team should create the subcon- 
tractor selection criteria using the template provided. 

[0163] Next, in step 561(if), the organization should 
develop a subcontract pricing mode. In general, after defin- 
ing the statement of work, it is necessary to establish the type 
of contract that will be used for the subcontract. It is 

important to detemime the type of contract early in the 
process, as it has a fiuidamental impact on tlie subcontrac- 
tor's proposal and economics of the program. Tliis work 
should be closely coordinated with the development of the 
contract strategy. 
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[0164] Returning to FIG. 5H, the organization's next 
action during the planning of subcontractor management in 
step 561 is to create a subcontractor long list, step 561(e). 
Usmg the subcontractor selection criteria template provided, 
the organization in step 561(e) identifies the long list of 
subcontractors that will be invited to propose. This list may 
be based on the following criteria: satisfaction with existing/ 
previous subcontractor work, market share of the subcon- 
tractor, industry reputation of the subcontractor, proximity 
of the subcontractor, availability of the subcontractor, finan- 
cial status of the subcontractor, etc. 

[0165] As depicted in FIG. 5H is the prepare/finalize 
request for proposal (RFP), step 561(/). The RFP should be 
created in stop 561(/) after tlie need for a subcontractor lias 
been established in step 561(a), the statement of work has 
been defined in step 561(6), tlie selection criteria liave been 
established in step S61(c), the pricing model has been 
estabUshed in step S6'l(d), and the appropriate terms and 
conditions have been established. The RFP should be final- 
ized with input from all relevant stakeholders. 

[0166] As depicted in FIG. 5G, the next task in the 

supplier agreement management in step 560(a) is to orga- 
nize subcontractor management resources, step 562. The 
organization performs step 562 to organize resources asso- 
ciated with subcontract management. In step 562, the project 
Work Plan is updated to account for subcontractors. Tasks 
that will use subcontractor resources are documented. Sub- 
contractor Selection Criteria are finalized and a subcontrac- 
tor is selected. Turning now to FIG. 51, the organization of 
subcontractor management resources in step 562 comprises 
the tasks of developing work breakdown structure (WBS) 
and a resource-loaded work plan, step 562(a); finalize sub- 
contractor selection criteria, step 562(A); issue a request for 
proposal (RFP), step 562(c-); receiving bids, step 562(rf); 
evaluating bids to select a suitable subcontractor, step 
562(e); and negotiating and finalizing a subcontract, step 
562(/). It should be noted tliat steps 562(a)-(e) in the flow 
chart in FIG. 51 represent the potential tasks that would be 
completed to select a subcontractor, but many of these steps 
may be omitted based on project requirements. 

[0167] In the development of the WBS and resource- 
loaded work plan of step 562(a), the WBS decomposes each 
business capability into manageable units and depicts the 
total scope of the solution needed to achieve the program/ 
project objectives. The work plan sets out the major work 
processes and constituent units of work tliat will be used to 
accomplish tlie project. The resource-loaded work plan then 
matches available resources with each task in the work plan. 
Both the WBS and tlie resource-loaded work plan should 
document the tasks that will be completed using subcon- 
tractor resources. 

[0168] In step 562(6), the organization should finalize 
subcontractor selection criteria, as depicted in FIG. 51. In 

step 562(i), the organization updates the subcontractor 
selection criteria established during the plan subcontractor 
management of step 561 to finalize the criteria that will be 
used to evaluate subcontractor proposals. Continuing with 
FIG. 51, during step 562(c), the organization next issues an 
RFP and distributes the RFP to a list of subcontractors 
identified for solicitation in step 561(e). Tlie organization 
then receives bids, step 562{d), to gather proposals fi-om 
subcontractors. 



[0169] The organization should then evaluate the bids and 
select a suitable subcontractor, step 562(e) in FIG. 51. In 
particular, as bids are received from subcontractors, the 
responses should be entered into a subcontractor selection 
criteria matrix to facilitate the evaluation process. Evalua- 
tors should also review the potential risks associated with 
each subcontractor. Once all responses have been entered 
into the matrix and all potential risks have been assessed, a 
selection can be made by the organization. 
[0170] The organization should next negotiate and finalize 
a subcontract, step 562(f) in FIG. 51. After the subcontractor 
is selected, it may be necessary to make additional negotia- 
tions to finahze the contract. As a result of finalizing the 
subcontract, it may be necessary to update tlie project plan 
and/or subcontractor management plan with any new con- 
ditions, such as the need to provide project-furnished facili- 
ties. 

[0171] Returning to FIG. 5G, the next step in the subcon- 
tractor management in step 560(a) is to control subcontrac- 
tor management m step 563. In step 563, the organization 
acts during project execution to monitor and control sub- 
contractor activities for subcontractors that do not function 
as part of the project team. Subcontractors that work as part 
of the project team follow the processes outlined in the step 
of control project work in step 530. In addition, there should 
be regular status meetings with the subcontractor. Diuing 
step 563, the work and work products of subcontractors are 
monitored tlirough visual observation and/or Subcontractor 
Status Reports. Corrective action is taken as problems arise. 

[0172] Substeps 563(a)-(6) of the control subcontractor 
management in step 563 are depicted in FIG. 5J. Specifi- 
cally, in step 563(a), tlie organization monitor subcontractor 
performance: The project manager or designated team mem- 
ber overseeing the subcontractor should observe the sub- 
contractor's performance on a regular basis and manage all 
communications with the subcontractor. If the subcontractor 
fails to perform as expected (e.g., late delivery, poor quality, 
etc.), the organization should act to remedy these failures to 
minimize their harmfvil effects on the project. 

[0173] Likewise, in step 563(6), the organization should 
receive subcontractor reports, as illustrated in FIG. 5J. The 
subcontractor should submit al! reports to the project team as 
specified in the subcontract. This may include status reports, 
turn-around documents, invoices, metrics, etc. These reports 
should be used to track subcontractor performance against 
tlie work plan and schedule milestones and evaluate quality 
of work. 

[0174] Returning to FIG. 5G, the final step in subcontrac- 
tor management in step 560(a) is to complete subcontractor 
management, step 564. In step 564, project management 
verifies that tlie subcontractor has completed all tasks out- 
lined in the subcontract and that technical perfoniiance 
requirements are satisfied. If the subcontractor successfiiUy 
satisfies all contract requirements, both administrative and 
technical, the contract close out process occurs. If not, 
project management takes corrective action. Project Man- 
agement updates the Closing Memo based on subcontractor 
deliverables and performance as necessary. As depicted in 
FIG. 5K, tlie tasks in the completion of subcontractor 
management in step 564 include the detennination of 
whether contract requirements are satisfied, step 564(a); 
determining if technical performance requirements are sat- 
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isfied, step 564(6); transitioning responsibilities and work 
products, step 564(c); and closing contract, step 564(d). In 
determining if contract requirements are satisfied in step 
564(a), the organization assesses whether the subcontractor 
has failed to satisfy the contractual requirements. The orga- 
nization flirther determines if any corrective actions may be 

[0175] Continuing with FIG. 5K, in determining if tech- 
nical performance requirements are satisfied in step 564(A), 
the project manager or designated team member oversees a 
subcontractor and is responsible for assessing the technical 
performance of that subcontractor. The acceptance criteria 
for contractual closeout are documented in the SOW and 
should be used to evaluate the subcontractor's petfonnance. 
This assessment may include a review of deliverables, 
metrics, invoices, etc., submitted by the subcontractor. If the 
subcontractor fails to satisfy the technical performance 
requirements of the contract, corrective action may be 

[0176] Referring agaui to FIG. 5K, the next task in 
completing Ihe subcontractor management is the transition 
of responsibilities and work products, step 564(c); Once the 
subcontractor has successfully completed all work stated in 
the contract, it is necessary to transition the responsibilities 
and work products of the subcontractor to the appropriate 
party. Step S64(c) may require the subcontractor to train 
personnel in a given area, hand over system documentation 
and manuals, etc. 

[0177] Then, in step 564(d), the organization may close 
the contract with the subcontractor, as illustrated in FIG. 
5K, If the subcontractor successftilly satisfies both admin- 
istrative and teclmical contract requirements, the contract 
closeout process can occur. The contract closeout process 
may include the collection of information, such as perfor- 
mance metrics, from the subcontractor if this requirement 
was specified in the statement of work, request for proposal, 

[0178] Reftiming to FIG. 5G, the corollary to the subcon- 
tractor management of step 560(a) is the product acquisition 
of step 560(6). The first task in the product acquisition is to 
plan the product acquisition in step 565. Tlie organization 
performs step 565 to plan activities related to product 
selection and implementation. In step 565, the project's 
product needs are identified. The project's detailed approach 
to product acquisition is outlined in the Product Selection 
Approach. After determining a need for a product exists, a 
high-level review of the market is conducted to determme 
possible vendors and the product selection criteria are devel- 
oped. It should also be noted that, in some cases, there are 
outside factors tlrat govern the selection of products. There- 
fore, the following tasks 56S(a)-S65(rf) may not always be 
necessary or inclusive. In addition, these tasks are only 
necessary when the product will be turned over to the client. 

[0179] Turning now to FIG. SL, the first task in the 
plamiing of product acquisition in step 565 is to identify a 
need for a product, step 565(a). In step S65(a), the organi- 
zation determines if business needs can be satisfied with the 
implementation of an off-the-shelf product. Step 565(a) may 
also involve participation from the proposal/project team 
and the client. The organization may generally follow the 
guidelines in a DAR Reference document. Specifically, the 
triggers and thresholds documented in the project plan 



determine if it is appropriate to use DAR to evaluate the 
need and/or selection of an off-the-shelf product. The orga- 
nization may Ukewise use the project plan to describe the 
project's need for an off-the-shelf product and to identify the 
areas in which it may be necessary or desirable to use an 
off-the-shelf product. 

[0180] As depicted in FIG. 5L, the next task in the 
planning product acquisition in step 565 is to develop a 
product selection approach, step 565(6). In step 565(6), the 
organization may document the project's detailed approach 
for product acquisition. Likewise, another task in the prod- 
uct acquisition 560(6) is to survey potential product provid- 
ers, step 565(c). In step 565(c), the organization may con- 
duct a high-level review of the market to determine potential 
product providers or contact an alliances group for assis- 
tance in identifying providers. The organization may tlien 
document potential providers on a vendor long list according 
to product selection criteria. Tliis step 565(c) may include 
input from several different sources such as Internet 
research, participants with past project experience, indepen- 
dent product ratings, etc. In some cases, step 565(c) may not 
apply as the project sponsor may dictate the specific appli- 
cation to be used. 

[0181] Continuing with FIG. 5L, tile next task in the 
planiung of product acquisition in step 565 is to finalize the 
list the product providers to be invited to propose, step 
565(d). In step 565(d), the organisation identifies a list of 
product providers to be considered based on the information 
gathered during the survey of potential candidates. The 
organization may select providers that satisfy most of the 
project's requirements. In step 565(d), the organization may 
refer to predetemiined product selection criteria with the 
product providers to be considered. 

[0182] Continuing with FIG. 5G, the next task in the 
product acquisition step 560(6) is to organize product acqui- 
sition, step 566. In step 566, the organization organizes 
resources associated with product acquisition. Furthermore, 
tlie product selection criteria are finalized and vendors are 
invited to demonstrate their products. At the end of this task, 
final product selections are made. It should be noted tliat, in 
some cases, there are outside factors that govern the selec- 
tion of products, and, therefore, some or all of steps 565(a)- 
(e), described below in FIG. 5M, may be skipped as 
necessary. 

[0183] Turning now to FIG. 5M, the individual tasks that 
comprise the organization of the product acquisition in step 
566. Tlie first task is to finalize product selection criteria, 
step 566(o). hi step 566(o), the organization should develop 
finalized selection criteria based on the organization's eco- 
nomic needs and goals, such as costs, timeframe, and quality 

[0184] Next, in step 566(6), the organization may define 
business scenarios, as illustrated in FIG. 5M. Using the 
product selection criteria formed in FIG. 566(a), the orga- 
nization may develop business scenarios that may then be 
used to form a questionnaire. In this way, the business 
scenarios may be used to evaluate product fit and perfor- 
mance during vendor demonstrations. 

[0185] The next task in FIG. 5M is to prepare and 
distiribiite a request for proposal (RFP), step 566(c). In step 
566(c). the organization should develop a RFP that requires 



us 2006/0235732 Al 



22 



Oct. 19, 2006 



the vendors and providers to propose similar configurations 
and have all hardware, software, and on-site consulting 
services (in days) identified and itemized. Providers can also 
submit their idea of an optimal configuration. Furthermore, 
the RFP should include as much infonnation about appli- 
cation interaction as possible. 

[0186] Returning to FIG. 5M, another task in the organi- 
zation of product acquisition in step 566 is to conduct vendor 
demonstrations, step 566(d). In step S66(cf), each finalist 
should provide a product demonstration. During the dem- 
onstration, the organization should evaluate how well each 
provider/vendor meets the various business scenarios. 
[0187] Next, the organization may compare costs and 
benefits of product providers, step 566(e), as illustrated in 
FIG. 5M. In particular, the organization may use the product 
selection criteria to compare the proposals submitted by the 
product provider finalists. .Also evaluate the potential risks 
associated with each product. 

[0188] Continuing with FIG. 5IVI, another step in the 

organization of the product acquisition is to make a final 
product selection, step 566(/). The organization may select 
the product provider based on the final scores in the product 
selection criteria and an assessment of potential risks. Step 
566(/) may also includes the preparation of a purchase 
agreement or contract. It may also be necessary in step 
566(f) to update the project plan to document any new 
conditions that result from the product acquisition, such as 
the need to provide project-furnished facilities. 
[0189] Returning to FIG. 5G, the next step in the product 
acquisition of step 560(6) is to control product acquisition, 
step 567. In step 567, the selected product is installed, 
testing is perfonned, and the perfonnance of the product is 
evaluated. The organization may perform step 567 after 
acquiring the product to ensure that tlie product satisfies 
busmess needs and performs as anticipated. It should be 
noted tliat tliese tasks are typically perfonned only for new 
products that have not been previously tested and imple- 
mented. For products that have been previously imple- 
mented, application testing and performance are evaluated 
during previous product and acceptance testing. 
[0190] The substeps in the control of product acquisition 
in step 567 are depicted in FIG. 5N. The fiirst task in 
controlling product acquisition in step 567 is to install or 
otherwise use the product in the environment to be used for 
acceptance and performance testing, step 567(a). 

[0191] Next, in step 567(6), the organization conducts 
application testing, as illustrated in FIG. 5N. Specifically, 
once the product has been delivered, it is preferable in step 
567(6) to perforai a fit analysis to ensure that the software 
satisfies tlie business scenarios as originally intended. The fit 
analysis should map the product characteristics against both 
the existing user service class characteristics and the existing 
underlying components of the delivery veliicles (execution, 
operations, development, computing platforms, and network 
arcliiteclure). 

[0192] Continumg with FIG. 5N, the next task in the 
control of the product acquisition is to evaluate application 
performance, step 567(c). Tliree different methods are avail- 
able to evaluate product perfonnance in step 567(c): com- 
parison, application sizing, and electronic spreadsheet 
analysis. Comparison analysis may be performed using 



existing installations of the product with similar environ- 
ments, operations, and configurations. Some product ven- 
dors perform application sizing to determine if the product 
is adequate for the project needs, but results should be 
interpreted with caution. Electronic spreadsheet analysis 
translates business transactions into resource utilization and 
service times for evaluation. The accuracy of electronic 
spreadsheet analysis is driven primarily by the knowledge of 
business ilinctions, transaction rates, and package architec- 
ture. 

[0193] Returning to FIG. 5G, anotlier step in the product 
acquisition is to complete the product acquisition, step 568, 
to close out the product acquisition tasks. In step 568, project 
management determines if tlie contract requirements are 
satisfied. Once the product has been assessed and meets all 
performance and functional needs, the product and the job 
responsibilities associated with the product are transitioned 
to the appropriate party. At tliis point, the contract with the 
vendor is closed. The tasks in the completion of the product 
acquisition in step 568 are illustrated in FIG. 50. Specifi- 
cally, the completion of the product acquisition in step 568 
comprises the tasks of detennining if contract requirements 
are satisfied, step S68(a); determining if performance issues 
require contract to be closed step 568(6); transitioning the 
acquired product, step 568(c); and closing tlie product 
acquisition contract, step 568(d). In the determination of 
whether purchase contract requirements are satisfied during 
step 568(a). the organization assesses tlie product against the 
contract requirements to determine if the agreed upon con- 
ditions have been met. Next, in step 568(6), the organization 
determines whether performance issues require the product 
purchase contract to be closed. Specifically, the organization 
decides if the product meets performance requirements. If 
the product fails to meet performance requirements, it may 
be necessary to terminate the contract. Contact the alliances 
group for assistance in identifying a product with better fit 
or performance. 

[0194] Once the product has been assessed and meets all 
perfonnance and functional needs, it is necessary to transi- 
tion the product and the job responsibilities associated with 
the product to the appropriate party. Accordingly, in step 
568(c), tlie organization may transition the product as 
needeti, as illustrated in FIG. 50. Step 568(c) may require 
tlie organization to train the appropriate party, handing over 
system documentation and manuals, etc. Then in step 
568(<0, the organization may close the purcliase contract 
after verifying that contract requirements have been satis- 
fied. 

Delivery Management 

[0195] Returning to FIG. 1, the next step of the CMM in 
a BOX method 10 of the present invention is to implement 
delivery management 600. Delivery management 600 
relates to the activities undertaken to develop a system 
software application for eventual delivery to clients. Tlie 
Delivery management step 600 translates the required busi- 
ness outcomes into a business solution. A business solution 
is the combination of business process, a teclinology solu- 
tion and organizational changes that collectively create 
value by improving business performance. The Deliver>' 
Management Module defines a multi-fiinctional approach 
for taking each business solution fi-oni analysis to deploy- 
ment. As depicted in FIG. 6A, the delivery management 600 
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encompasses four stages of work: analysis, step 700; design, 
step 800; building and testing, step 900; and deployment, 
step 1000. One of the delivery programs should be mobi- 
lized for each business solution to be delivered. 

[0196] In analysis stage 700, the organi2ation accesses and 
defines tlie tasks to be accomplished for delivery of the 
desired products. During stage 700, business, user and 
interface requirements are defined as necessary to define and 
commit to a specific implementation and release plan. The 
information gathered during stage 700 focuses on business 
requirements, describing it to the level of detail needed to 
finalize the delivery releases, define the specific require- 
ments, and resolve implementation issues. As illustrated in 
FIG. 7A, the analysis stage 700 consists of defining a 
business case, step 710; gathering and analysis of require- 
ments, step 720; assessment of the deployment environment, 
step 730; and identification and analysis of the application 
and interface requirements, step 740. 

[0197] The first step in the analysis stage 700 is the 
defining of a business case, step 710, wliich is illustrated in 
FIG. 7B. In step 710, the organization defines the business 
case to determine benefits to be derived from, and justifi- 
cation for a proposed business solution. Wlien defining a 
business case in step 710, the organization first determines 
an economic evaluation approach, step 711. Specifically, the 
organization performs this task to obtain commitments from 
the appropriate stakeholders in the sponsoring oiganization 
on tlie overall implementation approach for the proposed 
solution. Tliis task treats the process of implementing a 
solution as an investment. 

[0198] The organization subsequently creates a model 
structure, step 712. During this task, the organization obtains 
an agreement from the sponsoring organization regarding 
the structure of the model used to detennine the benefits of 
implementing the proposed solution. For example, benefits 
to be derived may be expressed in terms of increased market 
sliare or reduced operating costs. 

[0199] The organization next forecasts baseline business 
performance, step 713, to detennine how the business 
should perfomi without the proposed solution. The next step 
in the analysis stage 710 is to project net change journey 
benefits, step 714, during which the organization attempts to 
predict and quantiiy the benefits that the sponsormg orga- 
nization should derive from implementing the proposed 
solution. A ftirther step in the analysis stage 710 is to 
assemble a business case, step 715. During step 715, the 
organization documents a rationale for implementing the 
proposed solution. Ultimately, this document should serve as 
a motivational tool for change. 

[0200] Turning now to FIG. 7C, the next step in the 
analysis stage 700 is tiie gathering and analysis of require- 
ments, step 720. In step 720, the current business environ- 
ment is assessed and new requirements for the business and 
users are defined. During the gathering and analysis of 
requirements in step 720, the organization analyzes its 
current business, step 722, to obtain an accurate picture of its 
elements, its operation, and its performance. Tlie organiza- 
tion then identifies user and business requirements, step 724, 
to define and document higji-level requirements for desired 
solutions. These requirements include changes to human 
performance, business process, and technology. The orga- 
nization should seek to ensure that these requirements meet 



the needs stated in the proposal, business needs statement, 
work request, or task order, including interfaces to other 
systems. During step 724, project participants impacted-by 
the requirements should be involved in the review and 
sign-off of the requirements. Another step in the gathering 
and analysis of requirements in step 720 is to document the 
new business environment, step 726. In step 726, the orga- 
nization documents user locations and transaction volumes 
in any new business environment. 

[0201] As illustrated in FIG. 7D, the analysis stage 700 
continues with the assessment of the deployment environ- 
ment, step 730, to ensure that deployment concerns and 
needs are considered sufficiently early in the development 
process. The objectives of the task are to consider the 
geographical, infrastructure, operational, and cultural differ- 
ences between the current structure of the sponsoring orga- 
nization and the desired structure, to define the deployment 
requirements, and to determine the optimal deployment 
mechanism. 

[0202] In the evaluation of the deployment environment in 
step 730, the organization assesses its release approach, step 
732, to review the deployment plan, particularly to identify 
risks and to justify costs for deployment. The organization 
fiulher identifies deployment requirements, step 734, to 
identify deployment requirements for tlie proposed solution. 
A key deployment requirement is the production and release 
of tlie deliverable product or service. The organization 
should document the identified deployment requirements 
witliin a business requirements document. 
[0203] The next step in the analysis stage 700 is the 
identification and analysis of the application and interface 
requirements, step 740. During step 740, (he application and 
interface requirements are prepared based on the business 
and user requirements gathered. All agreed-upon require- 
ments gathered to this point are entered in the Requirements 
Traceability Matrix. Step 740 is generally illustrated in FIG. 
7E and comprises these steps: transforming business 
requirements into more detailed application and iuterfece 
requirements, step 741; integration of perfonnance support 
requirements, step 742; recovering current application and 
interface design, step 743; identifying apphcation and inter- 
face quality requirements, step 744; analyzing application 
and interface requirements, step 745; and verifying require- 
ments doaimeiitation, step 746. 

[0204] During the transforming of business requirements 
mto more detailed application and interface requirements in 
step 741, the organization uses the business requirements as 
a starting point to develop the apphcation requirements. Tlie 
apphcation requirements should be in the context and scope 
of the business requu-ements. Also, these requirements 
should be verified to help ensure that the business process 
designs were properly interpreted. Then, in step 742, the 
integration of perfonnance support requirements, the orga- 
nization analyzes the tasks and factors that hinder user 
performance, taking into account their background and 
behavior. 

[0205] As illustrated in FIG. 7E, the next task in the 
identification and analysis of the application and interface 
requirements, step 740, is the recovery of current application 
and interface design, step 743. Tlie recovery of current 
apphcation and interface design in step 743 entails review- 
ing the current application/interface documentation and 
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physical structures to gather requirements that may be 
omitted from the new application/interface. Step 743 
includes the documentation of the present logical data 
structures. The organization should fiirther identify expected 
requirements that otherwise may be assumed by the business 
representatives and not considered. Another task in step 743 
is to verify that the review also covers interface require- 
ments. In this way, the recovery of current application/ 
interface design in step 743 provides an inventory for 
conversion and a potential starting point for bottom-up data 
modeling. 

[0206] Subsequently, in step 744, the oiganization identi- 
fies application and interface quality requirements, as illus- 
trated in FIG. 7E. During step 744, the organi22tion seeks 
to select the quality attributes used to measure the applica- 
tion/interface functional and usability requirements, as these 
quality attributes should guide the design. Using these 
requirements, the organization should analyze application 
and interface requirements, step 745. Specifically, the orga- 
nization should perform an analysis of the gathered require- 
ments using process, event, data and content modeling 
tecliniques. Similarly, tlie organization may use validation 
tccliniques to confirm requirements such as prototyping and 
simulations, flie orgamzation may also create cases or 
scenarios to ensure requirements will be operational. Tlie 
organization may additionally perform risk assessment 
against the identified requirements. Hie organization next 
documents the application and interface requirement speci- 
fications using a template. Tlie actual requirements should 
be documented using a requirements traceability matrix for 
future tracking against other work products. The organiza- 
tion should make verify requirements are documented in a 
maimer to ensure bicUrectional traceability so that it is 
possible to trace requirements from the requirements devel- 
opment phase to the testing phase and vice versa. In addi- 
tion, it should be possible to trace requirements across 
interfaces. In performing step 745, the organization prefer- 
ably involves project participants impacted by the require- 
ments in the review and sign-oflF of the requirements 

[0207] Returning to FIG. 7E, the next step is to verify the 
documentation of requirements, step 746. Specifically, the 
organization should review all requirement documents, such 
as executive architecture, development architectiue, and 
operational architecture, thereby ensuring that these doai- 
ments are in sync. 

[0208] Returning to FIG. 6A, the next set of tasks m tlie 
delivery management 600 is to design, step 800. The design 
stage 800 focuses on designing the components of the 
technology infrastructure, including the execution/opera- 
tions and development architectures. In addition, the design 
of the network, communication and computing platfonns is 
performed in this stage. Design work should be coordinated 
with the development of the business processes, technical 
solution and organizational changes required to support the 
new infrastructure. The design process 800 is comprised of 
two tasks: designing the technology infrastructure, step 801 
and designing the application, step 802. 

[0209] FIG. 8A illustrates one embodiment of the design 
of the technology infrastructure in step 801. One of the tasks 
m step 801 is to identify and analyze technology iiifrastruc- 
mre requirements, step 810. During step 810, the organiza- 
tion prepares for tlie selection and design of the technology 



infrastructure and establishes preliminary plans for technol- 
ogy infrastructure releases and product testing. Furthermore, 
teclinology-related requirements are refined to form the 
component requirements for the teclinology infrastructure. 
For instance, step 810, tlie requirements for the technology 
infrastructure are outlined and preliminary plans for tech- 
nology infrastructure releases and product testing are estab- 
lished. As this task is performed, technology-related require- 
ments are refined to form the component requirements for 
tlie technology infrastructure. Accordingly, a first task in the 
identification and analysis of technology infrastructure 
requirements during step 810 is to identify teclinology 
infrastructure requirements, step 811, as illustrated in FIG. 
8B. The organization performs step 811 to identify the 
functional, technical, and performance requirements for the 
teclinology infrastructure that should support the solution. 
During step 811, the organization also identifies key perfor- 
mance indicators, creates baseline estimates of transaction 
volumes and system size, and sets measurable targets for the 
perfonnance indicators. Key performance indicators exam- 
ined during step 811 include resource availability, capacity, 
througliput, reliability, scalability, and usability. 
[0210] As indicated in FIG. 8B, a second process in the 
identification and analysis of technology infrastructure 
requirements in step 810 is to assess the technology infra- 
structure's current environment, step 812. In step 812, the 
organization assesses the ability of the existing technology 
infrastructure to support identified technology infrastructure 
requirements. 

[0211] As depicted in FIG. 8B, the organization subse- 
quently analyzes any potential technology infrastructure 
requirements, step 813, to refine the detailed functional, 
teclmical, and performance requirements for the tecbiology 
infrastructure as outlined in the physical and perform;mce 
models and to cover any additional requirements during the 
assessment of the current enviromnent. The additional 
requirements may include user and sendee level require- 
ments, as well as any requirements for the development 
arcliitecture or the execution/operations arclutecture. The 
orgamzation seeks to analyze and dociuneut the require- 
ments for each component of the technology infrastructure 
and define additional needs. As part of step 813, the orga- 
nization also seeks to involve all project participants 
impacted by the requirements in (he review and sign-off of 
tlie requirements. 

[0212] Returning to FIG. 8B, otlier steps in the identifi- 
cation and analysis of teclmology infrastructiure require- 
ments in step 810 are (1) verification that requirements 
documentation is in sync, step 814, and (2) performance of 
risk assessment against the technical requirements, step 815. 

[0213] As illustrated in FIG. 8A, the next step in the 
design of the teclmology infrastructure, step 801, is the 
selection and design of execution/operation hardware, step 
820. The orgamzation performs step 820 to create and 
docmnent high-level design and component design for the 
execution/operation architecture. Preferably, to prepare for 
testing of the architectural components, an architecture test 
plan, conditions, scripts and other needed family are also be 
created or defined during step 820. 

[0214] FIG. 8C depicts the individual steps of the selec- 
tion and design of execution/operation hardware in step 820. 
A first step in the selection and design of execution/opera- 
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tion hardware in step 820 is to identify execution/operation 
arcliitecture component options, step 821, so that tlie orga- 
nization may create a list of suitable options for selecting 
and designing execution/operation architecture components 
that satisfy the technology infrastructure requirements. Tlie 
oiganization then selects any reused execution/operation 
architecture components, step 822, if the execution archi- 
tecture should utilize reused components iiom other 
projects, so that the organization may create a list of suitable 
options for selecting and designing those components that 
satisfy the execution/operation technology infrastructure 
requirements. The organization may also select packaged 
execution/operation architecture components, step 823, if 
packaged components should be used in the project. The 
organization may perform step 823 to evaluate packaged 
products then and to gain the sponsoring organization's 
approval to continue. If suitable reusable or packaged com- 
ponents camiot be found, the organization may also choose 
to design custom executioiVoperation architecture compo- 
nents, step 824. If custom execution/operation components 
will be created in the project, the organization may tlien 
compare reused or packaged execution/operation solutions 
against custom-designed alternatives. 
[0215] Another step in the selection and design of execu- 
tion hardware 820 is to design and validate the execution/ 
operation architecture, step 825, to develop a complete 
design for the execution/operation arcliitecture design after 
individual components have been selected or designed. The 
design for execution/operation architecture should also 
mclude custom component designs and any reused and 
packaged execution/operation arcliitecture extension 
designs. 

[0216] Another step in the selection and design of execu- 
tion/operation hardware 820 is to develop an execution/ 
operation architecture test plan, step 826, after the execu- 
tion/operation architecture design is understood and 
documented, including the selection of reused and packaged 
execution/operation components. The primary goal of step 
826 is to document test approaches and plans for tlie 
execution/operation architecture at the component and 
assembly level. 

[0217] The next step ui the design of the teclinology 
infrastructure during step 801 is to select and design devel- 
opment architeclure, step 830, as illustrated in FIGS. 8A 
and 8D. The organization may perform this task to create 
and document the design of the development architecture 
components and test plans for those components. Specifi- 
cally, the organization may create a high-level development 
arcliitecture and component designs. Preferably, to prepare 
for testing of the arcliitectural components, an arcliitecture 
test plan, conditions, scripts and other needed family are also 
be created or defined during step 830. 
[0218] FIG. 8D illustrates the substeps in the selection 
and design of development arcliitectiu-e in step 830. A first 
substep is to identify development architecture component 
options, step 831. In step 831, the organization may create 
and document the design of the development architecture 
components, as well as the test plan for those development 
arcliitecture components. The organization also finalizes the 
physical model and selects or designs for development 
arcliitecture components. 

[0219] Other tasks in step 830 include the selection of 
reused development architecture components fi-om the exist- 



ing technology infrastructure or from external sources, step 
832, and the selection of packaged development architecture 
components, step 833, if they should be used in the project. 
If tlie organization should use any packaged development 
architecture components, the organization should determine 
which pieces of the development architecture to use and to 
negotiate contracts with vendors, hi a preferred unplemen- 
tation of step 833, the organization also gathers additional 
infonnation during vendor demonstrations and site visits to 
evaluate the available packaged development architecture 
components. 

[0220] Another substep in the selection and design of 
development architecture of step 830 is to design custom 
development arcliitectiure components, step 834, if any cus- 
tom-designed components are needed. Tlie organization 
may choose to produce a design for each custom component 
in order to understand the complexity, effort, and skills 
required to design and build the components efficiently. 
[0221] In another embodiment of step 830, the organiza- 
tion also designs and validates the development architecture, 
step 835, to review the development architecture require- 
ments such as interfaces between components, to design 
custom development architecture components, and to incor- 
porate any reused or packaged components. The organiza- 
tion may also develop a development architecture test plan, 
step 836. The organization should develop a test approach 
and a plan for testing, concurrently with the design and 
prototyping of the development arcliitecture. Before devel- 
oping the test approaches and plans for each component and 
the assembly of the development architecture, the organiza- 
tion should further review the objectives and scope for the 
component, component acceptance, and assembly test 
approach as defined in the test strategy. 
[0222] Returning FIG. 8A, a preferred embodiment of the 
delivery management stage also includes a peer review, step 
840, of the other steps 810-830 undertaken during the 
process of designing the technology infrastructure, step 800. 
In the peer review, Hie organization verifies tlie accuracy and 
completeness of a dehverable product, whether it is a 
document or code, for any step in the delivery stage 600. It 
should be appreciated tliat, wlnle displayed at tins point in 
the CMM in a BOX method 10, a peer review 240 may be 
implemented at any time as necessary to satisfy the require- 
ments of the CMM or CMMI as well as other overriding 
business concerns. 

[0223] Referring to FIG. 8E, the organization implements 
the peer review by first preparing for the review, step 842. 
Specifically, the project manager and team leader should 
budget time to conduct peer reviews and to estabhsh peer 
review standards and criteria. Also, the owner of the deliv- 
erable product should identify and contact any peer review 
participants, schedule the peer review session, and distribute 
materials and standards to the reviewers. The reviewers 
should then prepare for the review by reading the materials 
prior to the peer review session and documenting comments 
and recommendations. Where appropriate, a peer review 
checklist may be used when conductmg the peer review. 

[0224] Continuing with FIG. 8E, the next step in the peer 
review 840 is to conduct the peer review, step 844. During 
the peer review session in step 844, the deliverable owner 
should document any defects, issues, risks, and action items. 
Tlie deliverable owner should also record meeting minutes 
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and the time spent on the review. The reviewers are gener- 
ally responsible for facilitating the discussion, sharing com- 
ments and recormneadations with the deliverable owner, 
confirming that all issues are documented, providing metrics 
data, and scheduling a follow-up session if necessary. 
[0225] Next, in step 846, the organization should perform 
any necessary rework of the product, as depicted in FIG. 8E. 
During the rework in step 846, the deUverable owner imple- 
ments tlie actions reconniiended by the reviewers, collects 
metrics data (including time spent preparing for review, 
number of defects fotind, etc.), and monitors the status of 
defects, issues, risks, and action items. As necessary, the 
peer reviewer should also verify that all pertinent items have 
been closed. 

[0226] The organization should tlien analyze the review 
results, step 848 as depicted in FIG. 8E. Tlie team leader 
submits the peer review metrics to the project manager for 
review. The project manager is then generally responsible 
for analyzing the metrics, evaluating the execution of the 
peer review process, and identifying areas for process 
improvement or corrective action with the peer review 
process. 

[0227] Returning to FIG. 6A, the next step in the delivery 
management, in step 600, is to design an application, step 
802. As illustrated in FIG. 8F, during the design of the 
application in step 802, the organization designs an appli- 
cation architecture, step 850, to develop and document the 
conceptual and general design of the application and designs 
a database, step 860, to transform the data model into logical 
and physical designs of the application's database, while 
ensuring that data requirements should be met, and that data 
should be available through a conversion process. The 
design of the appHcation in step 802 also entails plamiing a 
testing approach, step 870, for developing a comprehensive 
testing approach that should be used at all levels of testing, 
including component, assembly, product, user acceptance 
testing, and production readiness, i.e., deployment testing. 
Then, in step 880, the organization designs a performance 
support approach to determine existing workforce training 
needs, as well as to design methods and standards for 
performance support products to meet those workforce 
training needs. 

[0228] During the design of the application architecuire in 
step 850, tlie organization seeks to develop and document 
the conceptual, general, and interface designs of die appli- 
cation. Preferably, to prepare for testing of the architectiual 
components, an arcliitecture test plan, conditions, scripts and 
other needed family are also be created or defined. As 
illustrated in FIG. 8G, the first step in the design of the 
application architecture in step 850 is to define the concep- 
aial design, step 851. Specifically, the organiaition should 
document the operational concept for the solution in the 
concepmal design document. Tliis documentation should 
outline the fimctional architecture of the proposed solution. 

[0229] Continuing with FIG. 8G, the organization should 
next detennine whether to buy or build components, step 
852, by reviewing tlie conceptual design and assessing 
factors such as historical infonnation, corporate strategy, 
support infrastrucftire, product availability, deadlines, and 
criticality of requirements. At tliis point, the organization 
should define an appUcation architecture, step 853. When 
defining the application architecture in step 853, the orga- 



nization should determine an approach for conducting 
design, such as calling group meetings for creating a con- 
ceptual approach. The organization should then evolve the 
conceptual design into a more detailed design as necessary 
for implementation with application. While evolving the 
design, key design decisions may trigger the need for a 
DAR, as described above. 

[0230] Contmumg with the design of the application archi- 
tecture in step 850, as depicted in FIG. 8G, flie organization 
next undertakes the concurrent tasks of defining a process 
flow in step 854, designing application interfaces in step 
855, and planning an assembly test in step 856. In defining 
a processing flow in step 854, the organization identifies all 
programs m the application, identifies their sequence, 
decomposes the programs into modules, and identifies how 
the modules communicate. The aim of step 854 is to develop 
enough detail to estimate the application's costs, resource 
consumption, and response times. 

[0231] At the same time, the organization designs appli- 
cation interfaces, step 855. Specifically, the organization 
designs the automated interfaces between the application 
being built and other applications with which it should 
coimminicate. During step 855, the organization also pref- 
erably develops an interface agreement and interface design 
to outline the expectations of the parties developing the 
various components. Tliese documents should describe the 
handling of change requests, data exchange and control, 
backup and recovery requirements, error handlmg proce- 
dures, and provide escalation procedures in the event of a 

[0232] At the same time, tlie organization also plans 
assembly tests, step 856, by developing an approach and a 
plan that should be used to organize and execute assembly 
tests. Tlie objective of assembly testing is to ensure that 
related components fimction property when assembled into 
dialogs or batch strings and to verify that the component 
interfaces have appropriately implemented the design. 
[0233] As illustrated in FIG. 8F, the next step in the 
application design 802 is to design a database, step 860. 
When designing a database in step 860, the organization 
transfonns the data model into logical and physical designs 
of tlie application's database, acts to ensure that all data 
requirements should be met, and that all data should be 
available through the conversion process. The steps in the 
database design 860 are illustrated in FIG. 8H. The first step 
in the database design 860 is to design a logical database, 
step 862. The organization may perform this task to trans- 
form tlie data model into the logical data structures using 
known database techniques. If the design of the logical 
database in step 862 produces a relational database, the 
logical database includes tables that contains various data 
used to define the database such as columns, primary keys, 
and row lengths; codes tables; foreign keys; integrity rules; 
views; and denormalization of the statistical data contained 
in the database. The logical data model is typically delivered 
to a client in soft copy formal using data modeling tools. 

[0234] Next, the organization designs a physical database, 
step 864, by selectmg or preparing physical storage and 
access structures for the application's data and by trans- 
fonning the logical database design into storage and access 
structures tliat can be physically implemented. Tlie physical 
database produced in step 864 generally includes database 
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definitions, database space worksheets, database mappings, 
relational index definitions, and table space definitions. The 
database design 860 continues witli designing data conver- 
sion processes, step 866, such that the required conversion 
programs and procedures ensure the availability of data 
required by the application in production, hi this step, the 
organization should produce an approach for converting and 
mapping documents. 

[0235] Returning to FIG. 8F, the design of tlie application 
in step 802 continues witli the development of a planning 
testing approach, step 870. This planning testing approach 
should be used at multiple levels of testing such as compo- 
nent, assembly, product, and user acceptance testing, and 
deployment testing. As illustrated in FIG. 81, the first step 
in the development of a planning testing approach in step 
870 is to develop an overall testing approach by refining and 
documenting an overall approach for testing, step 872. In 
developing tlie overall test approach, the organization 
should plan for the testing of interfaces. Tlie overall test 
approach produced in step 872 should include details on 
sequence testing and the testing environment and also pref- 
erably includes the dociunentation of the resulting detailed 
testing procedures. The next two steps in producing a testing 
approach in step 870 are (1) to identify product test condi- 
tions, step 874, where the cojiditions are used to verify that 
solutions meets the requirements for the components being 
created; and (2) to develop product test cycles, step 876. 

[0236] ReUiming to FIG. 8F, the next step in the appli- 
cation design 802 is to design a perfonnance support 
approach, step 880, to determine existing workforce training 
needs, as well as to design methods and standards for 
performance support products to meet these workforce train- 
ing needs. In step 880, the organi2ation also designs perfor- 
mance support test and evaluation approaches and completes 
a validation of the complete test and evaluation approach. 
With reference to FIG. 8J, the first step in the design of a 
performance support approach is to detemiine performance 
support needs, step 881, to determine the workforce's cur- 
rent proficiency and performance levels. Tliis information is 
used to assess the gaps between current and expected 
proficiency and performance levels, which, in turn, drive the 
design of the performance support approach. Next, the 
organization designs learning objectives and a ciirriculiun 
plan necessary to close the proficiency and performance 
gaps in the organization's workforce, step 882. Another step 
of die design of a performance support approach is to design 
performance support products, step 883, to define the deliv- 
ery methods and standards for performance support. These 
delivery methods may include instructor-led training, per- 
formance simulation, computer-based training, videos, 
workshops, job aids, on-hne quick reference tools, and 
training databases. 

[0237] As illustrated in FIG. 8J, the next step is to design 
a comprehensive approach for testing tlie performance sup- 
port products with respect lo achieving each product's 
learning objectives, step 884. In step 884, the organization 
generally defines an approach that includes the scope and 
objectives of the test, environment requirements, entry/exit 
criteria, metrics, and schedule. The organization tlien 
designs a comprehensive approach for evaluating the eflect 
of the perfonnance support products on the employees' 
competency proficiency levels and performance levels in 
specific areas, step 885. Any designed approach for perfor- 



mance support evaluation should include evaluation meth- 
ods, proficiency metrics, and schedules. The design of the 
performance support approach in step 880 may also include 
the verification and validation of the performance support 
approach and the curriculum plan with stakeholders and 
subject matter experts, step 886. Tlie organization should 
also organize labor review sessions to determine how well 
tlie sessions fit together to support the training needs of the 
workforce. 

[0238] As illustrated in FIG. 6A the next step in the 
delivery management 600 is to build and test, step 900. Die 
build and test step 900 concentrates on implementing the 
business solution elements required for a single release. Tlie 
delivering teams are responsible for the detailed design and 
creation of new processes, facilities, learning systems, per- 
formance support, application systems and technology infra- 
structure necessary to implement the new solution. These 
elements are then tested and implemented within a pilot 
environment. Thus, the building and testing in step 900 is 
accomplished through building and testing the teclmology 
infrastructure in step 901, building and testing the applica- 
tion in step 902, and planning executing product and accep- 
tance tests in step 903. 

[0239] FIG. 9A presents the elements in the building and 
testing of the technology infrastructure in step 901. Step 901 
focuses on acquiring, developing and testing tlie technology 
infrastructure. During step 901, additions and extensions to 
the execution/operations and development arcliitectures are 
implemented, physical network and computing resources are 
developed, and a unified product is tested prior to the 
application product test. The first task in step 901 is to 
acquire physical enviromnent assets and services, step 905. 
Generally, these physical environment assets and .services 
are deployed to enable the implementation of the require- 
ments based on the previously defined details of the physical 
environment assets. For instance, the organization may 
apply the data obtained in step 420. Tlie organization uses 
the listing of physical environmenl assets and services lo 
decide who should supply the assets and services, how the 
assets and services should be supplied, and how much the 

[0240] As depicted in FIG. 9B, tlie first step for acquiring 

acquisition of physical enviromnent assets and services by 
selecting and appointing providers of assets and services, 
step 906. For instance, tlie organization preferably identifies 
those contracts that need to be negotiated on an expedited 
basis and ensures that due diligence is applied to the context 
and content of all contractual arrangements. The orgaui2a- 
tion then selects and appoints assets and services vendors, 
step 907, to appoint third-party suppliers and contractors 
who may provide assets, such as property' and equipment, 
and teclmical/build/transfer/install/maiiitenance services for 
deployment of the physical environment, or services relating 
to decommissioning and disposal of the existing physical 

[0241] Again, the organizations should prioritize those 
early purchase requirements that need to be expedited on a 
"fast track" basis. Subsequently, the organization should 
evaluate the deployment implications of tlie vendor appoint- 
ments, step 908, to analyze the impact and deployment 
implications of appointing specific providers, either external 
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or internal. These impacts may involve additions or revi- 
sions to project documents such as deployment plans, Busi- 
ness Case, project plan, and all subordinate plans. 

[0242] Returning to FIG. 9A, the next step in the building 
and testing of the teclinology infrastructure, step 901, is to 
build and test the execution/operation architecture, step 910, 
in order to complete a detailed design of the execution/ 
operation architecture and to build and test that architecture. 
Tlie organization may use the same methodology for appli- 
cation and operation development, as provided above in step 
820, to plan and perfomi the component tests of the execu- 
tion/operalion architecture. As illustrated in FIG. 9C, the 
first step in the building and testing of the execution/ 
operation architecture is to develop program specifications 
for each custom component of the execution architecture 
and to determine software configurations for each packaged 
or reusable component of that architecture, step 911. The 
organization may use the resulting detailed design to build 
custom components and to install packaged or reusable 
components. Tliis task may also include updating tlie tech- 
nology infrastructure component test plans, conducting 
reviews of the resulting detailed designs, and preparing 
common test data. 

[0243] The organization next builds any custom execu- 
lion/operation architecture components needed for the 
project, step 912. Tliis step 912 may also include document- 
ing devclopmenl procedures and standards, and conducting 
code reviews. The organization then prepares and executes 
a component test of the execution/operation architecture 
components, step 913, to verify that the execution/operation 
arcliitecture components are built according to proper 
designs. During step 913, any detected errors should be 
documented, and all of the execution architecture compo- 
nents should be relatively free of errors and ready for a 
subsequent assembly test. 

[0244] As depicted in FIG. 9D, the organization should 
similarly build and test the development architecture, step 
915. The first task in step 915 is to perform a detailed design 
of the development arcliitecture, step 916. In step 916, the 
organization develops program specifications for each cus- 
tom component of the development architecture and to 
determine software configurations for each packaged or 
reused component of tliat arcliitecture. Step 916 also pref- 
erably includes updating the technology infrastructure com- 
ponent test plans, conducting reviews of the resulting 
detailed designs, and preparing common test data. Tlie 
organization should then build any needed custom develop- 
ment architecture components, step 917. Step 917 may also 
include documenting development procedures and stan- 
dards, and conducting code reviews. The organization flien 
prepares and executes a component test of the development 
architecture components, step 918, to verify that the devel- 
opment architecture custom components are built according 
to their designs. During step 918, the detected errors should 
be documented, and all of tlie development architecture 
custom components should be relatively free of errors and 
ready for tlie assembly test. 

[0245] As depicted in FIG. 6A, the build and test stage 
900 also includes the building and testing of the application 
m step 902. Step 902 focuses on building and testing the 
application, creating training materials and other forms of 
performance support required by the business solution. 



During step 902, the detailed design, component testing and 
assembly testing of the application are completed. Learning 
products and business policies and procedures are developed 
to train and guide the users of tlie application. FIG. 9E 
illustrates the steps involved in the process to build and lest 
the apphcation, step 902. Tlie first of these tasks is deploy- 
ment planning, step 930, to produce deliverables that should 
be needed to test the application and interfaces in an 
operations environment prior to deployment and to run the 
application and interfaces after deployment has occurred. 
[0246] Turning to FIG. 9F, the first task in the deployment 
planning during step 930 is to develop a deployment 
approach to document tlie specifics of the major deployment 
activities, step 931. The dociunentation should include items 
such as Data Conversion, Policy & Procedure Deployment, 
Risk Mitigation, Deployment Strategy, and workforce tran- 
sition also should be covered in this document. The orga- 
nization should next develop appropriate operating policies 
to produce a document oulhning specific policies in the new 
operation enviromnent, step 932. Responsibilities, system 
availability, and security should be documented in step 932, 
and upon completion of the project, this documentation 
should be given to the client. In a concurrent task, step 933, 
the organization may develop operating procedures by pro- 
ducing a document outlining the procedures that need to be 
followed during on-going support and operation of the 
installed application. Other subsequent tasks are to develop 
the operating organization to document the long-term orga- 
nizational requirements that should be needed in the new 
operation enviromnent, step 934, and to develop a disaster 
recover^' plan that outlines an overall disaster recovery 
approach, as well as speciiic steps to follow during the 
disaster recovery process, step 935. The organization may 
then prepare the deployment test by creating a deployment 
test plan, test conditions, test scripts, and test data, step 936. 
This plan should be executed prior to delivery of a product 
to clients. Another step is to package operating manuals, so 
that the manuals may be turned over to client at completion 
of the project, step 937. 

[0247] Tlie next step 940, the performing of application 
detailed design, is illustrated in FIG. 9G, and generally 
comprises a process to produce completed detailed design 
specifications that can be directly implemented in code, and 
a process to develop the approach and plan for component 
testing the application's modules. Tlie first substep is to 
design and specify modules, step 941. Step 941 includes the 
production of a detailed design of the application and 
interfaces based on the general design and the application/ 
interface requirements specification. During step 941, the 
organization should continue use of the chosen design 
methods to complete detailed designs. Tlie organization 
should also prepare a detailed design of the application by 
specifying all of the modules and their associated call 
patterns to the lowest level of detail. The detailed design of 
the application should also include describing eacn module's 
purpose and processing logic, developing database access 
patterns, and identifying other input/output operations. Tlie 
organization should also be sure to address interfaces during 
the design process. In step 941, the organization should also 
update the interface agreement created during the design 
stage 600 to reflect any changes associated with the inter- 
faces. The next task in perfonning a detailed design of the 
application in step 940 is to plan component testing, step 
942, to verify the correctness of implementation of each of 
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the application modules with respect to the application 
detailed design specifications. Step 942 includes determin- 
ing common test data requirements and using the require- 
ments to create common test data that can be used in the 
different stages of testing. 

[0248] As illustrated in FIG. 9H, the next step in tlie build 
and test stage 900 is to build and test the application, step 
945. In step 945, the organization builds a complete, higli- 
quality software application from tlie detailed design of the 
application. Tlie organization may have developers imple- 
ment the modules and tlien review the coded modules to 
verify correctness. The organization may also execute 
assembly tests to check interfaces and interdependencies 
between modules. One task in the buildmg and testing of the 
application is the coding of modules, step 946, to create the 
code of each of the modules according to the previously 
created detailed application design specifications. Once the 
code is generated, the organization should check and com- 
pile the code as necessary for the project to identify and fix 
all errors, and to ensure that developers have followed any 
detailed coding procedures outlined in the project develop- 
er's guide. 

[0249] Continuing with FIG. 911, the goal of the next step, 
the preparation and execution of the component tests in step 
947, is to execute module code and verily that the module 
specification was correctly translated to the code. The mod- 
ule code should be verified using the component test con- 
ditions from the component test plan to prepare the test data 
and test scripts for the component tests. The organization 
should document and fix all detected eirors before proceed- 
ing. Tlie organization may then prepare and execute assem- 
bly tests, step 948, as needed to integrate modules and verify 
that their interfaces and interdependencies are correctly 
designed and implemented. In step 948, the organization 
should use the assembly test conditions from the previously 
prepared assembly test plan to prepare test data and test 
scripts for the assembly tests. All detected errors should be 
fixed before proceeding. Tlie next step, the development of 
a support program in step 949, involves coordinating and 
controlling the efforts of the development teams by support- 
ing the programming and testing effort through superx'ision, 
control, and coordination. Hie organization may manage the 
programming and testing schedule, and monitor progress 
and report status, via the project management task packages 
outlined in the document repository policy defined in earlier 

[0250] As depicted in FIG. 91, at this point in the build 
and test stage 900, the organization may develop a finalized, 
detailed set of policies and procedures, step 950. The busi- 
ness policies and procedures consist of rules governing work 
within the organization (poHcies) and the workflow for 
executing these rules (procedures). A first task ui step 950 is 
to perform a detailed design of pohcies and procedures, step 
952. In step 952, the organization should (1) define tlie 
product structure and design and (2) create and develop 
prototype templates for all policies and procedures. The 
organization should then develop business policies and 
procedures, step 954, by drafting a complete set of business 
policies and procedures to support the pending product 
release. In step 954, the business policies describe the 
business rules governing workflows and drive the develop- 
ment of business procedures and user procedures documen- 
tation. Similarly, the business procedures describe the 



sequential sets of tasks (and related resources, metrics, etc.) 
to follow based on the business policies. The organization 
should next validate and test these policies and procedures, 
step 956, to ensure that the Business Pohcies and Procedures 
meet the content of the requirements and can be executed by 
use of the applicable application. In step 956, the organiza- 
tion should ftuther verify that the information collected is 
complete and accurately describes tlie processes. 

[0251] Turning to FIG. 9J, the next task in the building 
and testing of an application in step 900 is to develop 
learning products, step 960. In step 960, the organization 
selects the relevant authoring and development tools and to 
define standards, templates, and development procedures. 
Step 960 further includes the defining of detailed learning 
objectives, determining learning context, and desigrung 
learning activities. The organization should also review 
paper-based learning product prototypes for ease of use. 
Also, the organization should develop activities and content, 
and define the support learners should require, and develop 
leaming program evaluation materials for duriug-delivery 
and post-delivery evaluation of the learning process. Tlius, 
in step 960, the organization should prepare and execute 
testing to ensure each learning product meets the slated 
objectives and instructors are effective when using the 
leaming products. 

[0252] As depicted in FIG. 9J, one task in the develop- 
ment of leaming products in step 960 is to define learning 
product standards and a development environment, step 961, 
after the scope of tlie learning program has been defined and 
the leaming requirements liave been identified, hi step 961, 
the organization should fiirther select authoring and devel- 
opment tools and define the standards, templates, and pro- 
cedures for the learning products. Development environ- 
ments typically include Word or PowerPoint-based 
instnictor-led materials or computer-based applications, but 
can also be made more robust with the use of job aids, a 
training database, on-line quick reference tools, and videos. 

[0253] Returning to FIG. 9J, concurrent steps in the 
developing of learning products in step 960 are (1) perform- 
ing a detailed design of a leaming program, step 962, to 
specify how each learning product identified in the learning 
product design should be built to meet the business needs of 
the organization and (2) prototyping leaming products, step 
963, to complete low-fidelity prototypes and conduct ease- 
of-use sessions on leaming components (e.g., activities, 
support system, and instructor guide) of classroom-based 
leaming products. 

[0254] In addition, the organization may create learning 
and evaluation products, step 964, to develop the leaming 
materials proposed and prototyped during the learning 
design activities. The creation of leaming and evaluation 
products in step 964 involves the developing of activities, 
content, and support materials tliat the learner will require to 
complete the leaming product. Furthermore, evaluation 
tools are also preferably created in step 964 to ensure that 
learners have met the leaming objectives. Another possible 
task in tlie development of leaming products in step 960 is 
the testing of leaming products, step 965, which is best 
implemented after documenting participant profile, sample 
size, learning testing methods, test cycles, expected results, 
and script outlines. Tlie goal is to test each leaming product 
with the intended audience to ensure that the product meets 
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the stated learning objectives, that the instructors are effec- 
tive, and that the learning product meets the overall learning 
objectives for the release. The organization may also pack- 
age the learning products, step 966, so that the learning 
products may be handed over to an appropriate stakeholder 
at the end of the project. 

[0255] At this point, the organization may plan and 
execute the product test and acceptance test, step 903, as 
illustrated in FIGS. 6 and 9K. Product tests evaluate 
whether the product is properly fimctioning, whereas accep- 
tance tests evaluate whether the product functions as desired 
by customers. Step 903 focuses on performing a product test 
and user acceptance test on the new apphcation to verify the 
application components and related technology, processes, 
and procedures work together properly according to the 
application and interface requirements. Tlie first task in step 
903 is to prepare and execute a product test plan, step 970, 
following the creation of tlie product test plan, conditions, 
scripts, and data that are used to execute tiie product test. The 
planning and execution of the product test plan in step 970 
should not begin until all requirements are finalized, the 
assembly test has been successfully completed, and the 
testing approach has been finished. 

[0256] As illustrated in FIG. 9L, to prepare and execute a 

product test, the organization should prepare a product test 
plan, step 971, to design and create the test conditions, test 
scripts, and test data for product testing. The organization 
should then review its product test plan, step 972, to verify 
tliat the product test plan created in step 971 is complete and 
accurate prior to product test execution. The resuhing benefit 
to this check is that errors are caught early in the test process, 
where they can be addressed with minimal effort, rather than 
during test execution, where correction of errors becomes 
more costly. The organization should also create, cleanse, 
and convert data, step 973, to prepare the data for product 
test execution. If needed, the organization may confirm the 
product test enviromnent, step 974, to verify tliat the product 
lest environment is ready for application product test execu- 
tion by confirming that associated items are transferred to 
the test environment and that the identified configuration is 
complete and accurate. In this way, in step 974, the organi- 
zation verifies that any tools needed for managing and 
executing the product test (for example, scripting tools and 
test data management tools) are installed and fully opera- 
tional. This step 974 also helps ensure tliat the test data is 
. properly copied and identifies responsibility and authority 
levels for managing code migration into tlie product test 
environment. 

[0257] Continuing with FIG. 9L, following confirmation 
of the test, the organization may execute the product test, 
step 975, to verify that the new application can work witli the 
related technology, processes, and procedures to support the 
business processes successfiilly. The product test should 
prove: (1) that the new application and interfaces perform 
according to the application/interface requirements estab- 
lished in prior steps, and (2) that the application can operate 
effectively in concert with all other production applications 
and all available end-user manuals and procedures. 

[0258] If any problems arise during the testing, the orga- 
nization may perform product test fixes, step 976, to analyze 
and resolve all problems identified during product test 
execution as illu.strated in FIG. 9L. Typically, the organi- 



zation assigns each problem to a specific team member for 
correction. After a problem is fixed, the organization may 
reexecute the test condition to verify that the fix was 
successful, and perfonn a regression test to ensure other 
components were not adversely aflfected by the fix. Once all 
errors have been resolved the product test can be considered 
complete. 

[0259] Retuming to FIG. 9K, the organization may next 
prepare and execute acceptance tests, step 980. The organi- 
zation performs step 980 to create the test plan, test condi- 
tions, test scripts, and test data for user acceptance testing. 
Tlie user acceptance test (UAT) also validates that the 
solution supports the business performance model and 
should not begin until successful completion of the product 
test in step 970. The UAT verifies thai the solution works 
according to the requirements and meets tlie busiaess objec- 
tives. As depicted in FIG. 9M, steps 981-986, the prepara- 
tion and execution of the acceptance tests during step 980 
are very similar to steps 971-976. For instance, the initial 
step of the preparation and execution of the acceptance tests 
in step 980 is to prepare a user acceptance test plan, step 981, 
including plans for testing interfaces and the application. 
The organization then reviews the user acceptance test plan, 
step 982, to ensure that the user acceptance test plan is 
complete. The next step is to create, cleanse, and convert 
data, step 983, as needed, to prepare the data required for the 
acceptance testing, including producing new data, convert- 
ing existing data, and reconciling different data representa- 
tions and different database schema representations. If nec- 
essary, the organizations may also confirm user acceptance 
of the test enviromnent, step 984, to ensure: (1) that the user 
acceptance test enviromnent is ready for test execution by 
checking that all necessary items are transferred to the test 
environment, (2) that the identified configuration is com- 
plete and accurate, and (3) that any tools required during the 
acceptance test are installed and fi.illy operational. 

[0260] At tills point the organization executes the user 
acceptance test, step 985, to test the interaction between the 
components of the solution to verify and validate that they 
support the model. This acceptance test helps to ensure that 
the solution works according to the requirements and meets 
the business objectives. If any problems arise in Ihe test, the 
organization may resolve user acceptance test issues, step 
986. Specifically, the organization may utilize the user 
acceptance test issues to analyze all problems identified by 
the user acceptance test execution tlirougli investigating 
each problem, and assigning it to the appropriate develop- 
ment team for correction. After a problem is fixed, the 
organization should reexecute tlie test condition to verify the 
fix was successfijl. The organization may also perform a 
regression test to eiisiue other components were not 
adversely affected by the fix. Once all errors have been 
resolved in step 986, the acceptance test may be considered 
complete. 

[0261] Once solutions lo a problem have been analyzed in 
step 700, designed in step 800, and built and tested in step 
900, an organization may deploy the complete solution, as 
depicted in FIG. lOA. Tlie deployment stage 1000 is con- 
ducted to transition the organization to the new business 
solution. The deployment stage 1000 includes the activities 
required to transform the persomiel, business process, and 
technology elements required to establish the busmess solu- 
tion. Tlie deployment stage is repeated for each deployment 
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site, which is the organizational or geograpliic unit that will 
receive the business solution. The first step in tlie deploy- 
ment is to transition users and to deploy policies and 
procedures, step 1010, to evaluate the existing workforce of 
an organization in terms of roles and skills, and perform a 
gap analysis against the new organization infrastructure for 
the deployment unit, as illustrated in FIG. lOB. In step 1010, 
the organization may finalize the woikforce infrastructure, 
step 1011, to mobilize the people who should eventually use 
the solution. At the same time, the organization should 
examine the organizational structure, as well as the skills 
and roles of the existing workforce, to detennine if the 
resoiurces needed to support the solution exist. If needed 
roles or skills are missing, another task in step 1011 is to 
develop a plan to address the gaps. This task should be 
performed before selecting, hiring, or assigning people to 

[0262] As illustrated in FIG. lOB, the next task is to 
redeploy the workforce, step 1012, to transfer existing users 
into the different roles, teams, or fimctional areas needed to 
support tlie solution. Concurrently, the organization recruits 
and selects a workforce, step 1013, after developing a profile 
of tlie combination of skills and other characteristics nec- 
essary to support the solution and using the resulting profile 
to select internal individuals and to hire external individuals 
who can fill the necessary roles and teams. The organization 
then trains the trainers, step 1014, by preparing the instruc- 
tors and coaches who should eventually train the workforce 
to use the solution. Step 1014 generally entails conducting 
practice sessions of the course in order to allow instructors 
to rehearse their delivery with course developers as the 
audience. Next, the organization implements orientation and 
training, step 1015. Specifically, the organization introduces 
employees to the solution tliat should be deployed. To 
maximize the benefits of training in step 1015, the instruc- 
tors should be trained in step 1014 prior to the training of the 
workforce. The organization may further give users infor- 
mation on the context of the solution witliin the otganization 
and train them on how to operate the solution. Furthermore, 
tlie otganization preferably identifies individual and team 
development needs, and workers should provide feedback 
on the learning program in order to improve the process for 
future releases. Step 1015 should be performed after select- 
ing and recruiting individuals to till the roles and teams, and 
after developing the training materials and job aids. 

[0263] Couctirrent with above-described steps 1 Oil -1 015, 
if needed in response to the deployment, the organization 
may install the new business policies and procedures, step 
1016. In step 1016, the organization also acts to en sure that 
all pieces of tlie new business policies and procedures are 
available. 

[0264] The next step of deployment stage 1000 is lo 
deploy the physical environment, step 1020, as illustrated in 
FIG. IOC. In step 1020, the organization manages the 
implementation of changes to facilities, equipment, and 
other physical assets. Upon completion of step 1020, a 
formal exchange of the transformed physical enviromiient 
from the project team to the sponsor's operating manage- 

[0265] Continuing with FIG. IOC, one task in deploying 
physical environment in step 1020 is to initiate physical 
environment deployment, step 1022, to mobilize the internal 



and external resources to prepare the physical environment 
for the solution that should be deployed, and to establish the 
necessary communication channels. One aspect of step 1022 
is to verify that all of the involved parties understand what 
work for which they are responsible, when this work is 
scheduled, and how this work is interdependent with the 
tasks assigned to others. Other tasks in step 1022 may 
include defining how to monitor, expedite, and report 
progress. Tlie organization may optionally determine how to 
maintain quality control and how to regularly communicate 
progress with stakeholders. Also, step 1022 may include 
planning for formal progress and quality control reviews. 
[0266] Returning to FIG. IOC, the next step in the deploy- 
ment of the physical environment during step 1020 to is to 
manage physical environment transformation, step 1024, to 
carry out the development and configuration of the physical 
environment needed lo support the solution. The manage- 
ment of physical enviromnent transformation in step 1024 
includes expediting progress, managing issues and risks that 
may impact the implementation plan, and providing man- 
agement with summary progress reports. 
[0267] Continuing with FIG. 1 OC, another the next step in 
die deployment of the physical enviromnent during step 
1020 is to complete a physical enviromnent handover, step 
1026. During 1026, the organization acts to ensure that the 
development and configuration of the physical environments 
are complete, and arc transferred lo, and accepted by, the 
sponsoring organization's operations management. Step 
1026 generally occurs when both the stakeholders and the 
deployment project management team are satisfied that the 
implementation has been completed successfully. 
[0268] As depicted in FIG. 1 OD, the next task is to deploy 
the application, step 1030, to transition the new application 
and its operating enviromnent into the deployment luiit. 
During step 1030. the organization may establish the data 
required by the new application; configure the operating 
environment to the needs of the deployment unit; install the 
application; configure application parameters needed for the 
deployment unit; and verify that the application is correct 
and consistent for the deployment. Tasks in step 1030 may 
include the creation, cleansing, and conversion of data, step 
1 032, as needed, to establish the data to be used with the new 
application. During step 1032, an organization may produce 
new data and reconcile different data representations and 
different database schema representations. The organization 
may also convert an existing electronic representation of 
data into a format to be used by the new application or use 
a data conversion application to convert data from an 
exi.sting database to the new database. 
[0269] As depicted in FIG. lOD, a concurrent task is to 
configure the application, step 1034 in order to configure and 
customize tlie new application and the existing operating 
environment to the needs of the deployment unit. Next, the 
organization installs the application, step 1036. Specifically, 
the organization may, diuring step 1036, install and custom- 
ize the application components of the business capability in 
the deployment unit, making sure that all pieces of tlie new 
application are available. Another task in tlie deployment of 
tlie apphcation during step 1030 is to verify application, step 
1038, by installing and customizing the new application 
components of the business capability in the deployment 
unit, making sure that all pieces of the new application are 
available. 
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[0270] As illustrated in FIG. lOE, another step in the 
deployment stage 1000 is to deploy the technology infra- 
structure, step 1040. During step 1040, the organization 
preferably outlines of tlie procedures and considerations for 
deploying technology infrastructure components at a 
deployment unit. Likewise, the organization should address 
the potential differences in technology infrastructure envi- 
ronments between deployment units. The goal of step 1040 
is to bring the deployment unit up to the technology infra- 
structure baseline required for the business capability. 
Deployment of the technology infrastructure in step 1040 
may also include the commissioning and decommissioning 
of infrastructure components. To deploy the technology 
infrastructure in step 1040, the organization may also con- 
figiu-e the teclmology infraslnicnire, step 1042, to customize 
the deployment miit's technology infrastructure in prepara- 
tion for the new business capability' components. Step 1042 
generally does not handle the configurations that are part of 
the installation of any new teclinology infrastructure ele- 
ments. Next, the organization installs the teclinology infra- 
structure, step 1044, to install the teclinology infrastructure 
components of the business capability. Tlie organization 
should also verify the available technology infrastructure, 
step 1046, so that whenever a teclinology infrastracture 
component is added or modified, the organization performs 
this task to verify the new technology infrastructure envi- 
ronment and addresses tiie discoveries of tlie testing. This 
verification in step 1046 is generally completed only for die 
technology infrastructure. 

[0271] The next task in the deployment stage 1000 is to 
activate and test a solution, step 1050, to verify the deploy- 
ment and launch the new operating management processes. 
Step 1050 generally includes actions required lo fin;ilizc 
performance targets, to remove redundant legacy elements, 
and to stabilize the deployment unit for transition to opera- 
tions management. One task in the step 1050 is lo verily 
workforce and business readiness, step 1051, after success- 
ful completion of the acceptance test and after all elements 
have been deployed, but before the business capability is 
activated. Step 1051 includes execution of the deployment 
test and verifies that the workforce and the other elements of 
the business are prepared for operation on the first day and 
all subsequent days. The organization may use the SIRs or 
CRs to record any errors encountered. 
[0272] A concurrent task is to verify team and process 
readiness, step 1052, after all elements have been deployed, 
but before the business capability is activated. Step 1052 
verifies that the deployment team and the deployment pro- 
cesses are prepared to activate the new business capability. 
Organizations may also activate and verily the deployment, 
step 1053, to activate and verify the capabilities that have 
been deployed. In step 1053, any of the organization's 
various teams should have the confidence and ability needed 
to proceed with irreversible decisions, such as the removal 
of legacy systems and procedures. The organization should 
now begin to operate the deployed business capabilities. 
[0273] Next, the organization may remove legacy ele- 
ments, step 1054, to remove the legacy systems from old 
operations and management processes after making the 
irreversible decision to proceed with the new business 
solution. Concurrent with step 1054, the organization should 
finalize perfonnance targets, step 1055 to fonnalize the 
baseline for continuous improvement of the business solu- 



tion. The finalizing of performance targets is initiated as 
soon as the business solution has been operating long 
enough to collect reliable data for adjusting the business 
perfonnance model. 

[0274] In another step, the organization may deploy sta- 
bilization, step 1056, to prepare the transition of business 
capabilities to operations management. The otganization 
should also monitor the progress over a period of time to 
verify the stability of the team using the deployed business 
capabilities. A decision that the product is ready to release is 
reached by analyzing tlie actual performance and produc- 
tivity forecasts of the team using die deployed business 
capabilities. 

[0275] Turning now to FIG. 6B, maintenance, step 610, is 
the continuing support of an application, addressing both 
production problem resolution (tlirough SIRs) and applica- 
tion enliancements (through CRs). The first task in tlie 
maintenance is to review the SIRs or CRs, step 611. With a 
SIR, repair work needs to be completed inmiediately, 
whereas a CR may be incorporated into a subsequent release 
of the application. The organization may also review inci- 
dent or change requests for risk as well. Another step in the 
maintenance 610 is to perform an impact assessment, step 
612. Specific activities in step 612 include investigating the 
SIR; deteniiining the change required to address the iden- 
tified problems to resolve the SIR; determining the effort 
involved; developing alternatives; and selecting the accept- 
able alternative. Any affected work products altered by the 
SIR such as requirements, designs, work plans, code, etc., 
should be updated as necessary. If it is determined that no 
application change is needed, the system should be retested 
to ensure that the problem no longer exists or that the 
problem should be forwarded to the appropriate channels. 
[0276] Anoflier task in the maintenance 610 is to design 
application changes, step 613, to create the application 
design that is needed to build the solution. The organization 
may also build and test application changes, step 614, to 
perform the work necessary to implement the desired 
change. Once the change has been completed, tlie cliange 
should be component tested and product tested to ensure that 
it is working properly. Additionally, a regression test should 
be performed in step 614 to help ensure that other peripheral 
flmctions were not affected by the change. Next, the orga- 
nization may roll out changes, step 615, as needed to 
implement the designed, developed, tested changes into the 
production environment. 

[0277] For CRs corresponding with desired enliancements 
to the product, die organization may also follow the program 
delivery life cycle, step 616: For changes (CRs) that can be 
incorporated into a scheduled release, the detailed work 
involved in modifying the existing application is performed 
according to tlie task packages/tasks in the delivering pliase 
600, including the analysis, design, build and test, and 
deployment steps 700, 800, 900 and 1000. In tliis way 
eiiancement that extend beyond the original scope of the 
product are developed much like a new product. 
System 

[0278] Those skilled in the art of process engineering will 
recognize that various embodiments of the CMM in a BOX 
method 10 described above may be implemented in various 
ways. For instance, the organization may use a set of written 
templates directing the implementation of the tasks in the 
CMM in a BOX method 10. 
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[0279] In one implementation, the present invention may 
be implemented as a computer application that prompts an 
organiaation for various inputs regarding its operation and 
structure. Using tliese inputs, the application then creates a 
series of task lists to implement the CMM in a BOX method 
10 of the present invention. The application may further 
create a record of task lists, so that the organization may 
easily document its actions as required in the CMM and 
CMMI. .Alternatively, the program may provide templates 
tlirough which the organization may document its activities. 
[0280] In particular, those skilled in the art will recognize 
that various embodiments of the CMM in a BOX method 10 
described above may be implemented using a combination 
of both electronic hardware and software. Referring to FIG. 
IIA, a CMM implementation system 1100 receives user 
input 1130 and produces a business organization plan 1140 
based on tlie user input 1130. The system 1100 may be, for 
example, a personal computer (PC), a server, or any other 
computer device used for such purposes. The system 1100 
may be coupled to a database 1120 containing information 
on the organization and its suppliers. In this embodiment, the 
system 1100 has an organization management module 1110, 
a program management module 1112, a project management 
module 1114 and a delivery management module 1116 for 
implementing organization management 100, program man- 
agement 400, project management 500, and delivery man- 
agement 600. 

[0281] If the computer device 1100 is, for example, a 
network server, in electronic communication with an elec- 
tronic network, then users 11 60 may be able to use the CMM 
system 1100 remotely. Referring to FIG. 11 It showing the 
computer device of FIG. 11 A in electronic conuntmication 
with a network 1150. llie network 1150, may be. for 
example, the Internet, an intranet, an extranet, a Wide Area 
Network ("WAN"), Virtual Product Network (VPN) and the 
like. Users 1160 may transmit user input data 1120 to the 
CMM system 1100 via the electronic network 1150 tlien 
obtain a business organization plan 1140 based on the input 
data 1130. 

[0282] In another embodiment, the CMM system 1100 
illustrated in FIGS. ll.A-B, may be a software application 
designed to operate over various liardware and computer 
systems, as known in the art. 

[0283] Tuming now to FIG. 12, one embodiment of the 
present invention implements Method 10 of FIG. tliroiigli 
the use of an accelerated process improvement framework 
system (APIF) 1200 including an enterprise doctunent man- 
agement system (EDMS) 1210. The EDMS 1210 is a 
software application that permits multiple users to store, 
retrieve, and manipulate electronic documents on a closed 
client/server arcliitecture network, such as a local area 
network (LAN) or wide area network (WAN). Known types 
of EDMS 1210 include DOCSFusion, available from 
PCDOCS, Inc., Toronto. Ontario, Canada and Enterprise 
Document Management in the Documentimi Suite available 
from Documentum, Inc., of Pleasanton, Calif. (http://www- 
.dociunentum.com). Tlie configuration of these and other 
document managers flinction m connection with the tech- 
niques of the present invention, and the operation of which 
will be apparent to one of ordinary skill in the art in view of 
this disclosure. 

[0284] The EDMS 1210 generally includes a digital 
library repository that creates a document space, which may 



use a replicated infrastructure for document storage. The 
repository stores a document as an object that encapsulates 
the document's content along with its attributes, including 
relationships, associated versions, renditions, formats, work- 
flow characteristics, and security. These document objects 
can be infinitely combined and re-combined on demand to 
form dynamic configurations of document objects that may 
originate from any source. In this way, the document space 
supports organization of documents via folder and cabinet 
metaphors and allows searching over both document content 
and attributes. The document space also provides check 
in/checkout-style version control, fiiU version histories of 
documents, and annotations (each with its own attributes 
and security rules), and supports workflow-style features 
including notification of updates. 

[0285] Continuing with APIF 1200 in FIG. 12, tlie EDMS 
1210 coimects to and administers one or more file storage 
devices 1220. The file storage devices 1220, such as various 
magnetic and optical storage media, are well known tech- 
nologies and are commonly commercially available. Alter- 
natively, the file storage devices 1220 may be on other LANs 
and WANs, or may be Storage Area Networks (SANS) or 
other network-based storage structures. The file storage 
devices may therefore be positioned at potentially great 
distances from tlie user. The user connects to these distant 
storage devices 1220 via various combinations of comiec- 
tions, networks, webs, intranets, internets, the Internet, etc. 
(not illustrated) that are well known in the field of computer 
coimiuinications. For example, tlie Documentiun Suite 
includes a DocControl Manager that runs on top of the 
Documentum repository to pennit secure management of 
controlled documents over the Web. Using the DocControl 
Manager, authorized users may instantly access and view 
documents using the browser or viewer of their choice. Tlie 
DocControl Manager thereby allows users to create, review, 
revise, approve and distribute controlled documents online 
witliin an audited environment. In place of elaborate manual 
processes, users may employ the DocControl Manager to 
create a Web-driven knowledge cliain tliat links discon- 
nected processes for collecting, sharing, and applying 
knowledge to meet stringent quality goals and compUance 
requirements. 

[0286] In the present invention, the file storage device 
1220 contains files 1222 that store data relating to one or 
more steps in Method 10 (FIG. 1). Thus, when performing 
a step in Method 10, a user may select a file 1222 corre- 
sponding to that step. The file 1222 may then provide the 
user with the information and instructions needed to accom- 
plish that step. For instance, the file may direct tlie user to 
undertake certain quality control actions during the devel- 
opment of a software application. The file 1222 may further 
specify documentation that must be completed by the user 
during the step. In this way, a user may perform Method 10 
of FIG. 1 by opening one or more files 1222, following the 
actions specified in the files 1222, and then, when appli- 
cable, completing required documentation specified in the 
files 1222. Tlie file 1222 may alternatively inslnicl the user 
on the relationship of that step witli other steps in Method 
10. In doing so, the file 1222 may direct the user to other, 
subsequent steps in Method 10 by directing tlie user to files 
1222 corresponding to these subsequent steps. 
[0287] Returning to APIF 1200 in FIG. 12, a document 
management tool (DMT) 1230 may operate m conjunction 
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with the EDMS 1210. The DMT 1230 maintains and tracks 
documentation needed for the method being implemented by 
the user. Documentation is important in many steps of 
Metliod 10 because it allows the user to subsequently verify 
completion of required actions, which the various CMM 
certifying bodies require before certifying that an organiza- 
tion has achieved higher levels of the CMM. The DMT 1230 
works in conjunction with tlie EDMS 1210. 

[028S] In particular, the DMT 1230 allows a progranmier 
to associate required documentation with files 1222 corre- 
sponding to steps in Metliod 10. A linking attribute may be 
added to each document object stored within the EDMS 
1210 to facilitate association of the documents with objects 
in the process control system. Once a user selects and opens 
a file corresponding to a step having required documenta- 
tion, the DMT 1230, working together witli the EDMS 1210 
may automatically present to the user an appropriate docu- 
mentation form. The DMT 1230 may also present completed 
examples to assist the user in completing tlie documentation. 
In tliis way, APIF 1200 helps the user to complete the 
necessary documentation for satisfying the requirements for 
certification. 

[0289] Alternatively, APIF 1200 may prevent the user 
from selecting other files 1222 that lead to additional steps 
in a process until the required documentation for the current 
task is completed. This lunction may be accomplished by 
altering the document permissions maintained by the EDMS 
1210 so that the user cannot access certain files until various 
conditions are satisfied. While the EDMS 1210 continues to 
administer storage and retrieval of files, the DMT 1230 
affects the ability of the user to access some files until certain 
conditions are met, i.e., completion of the required docu- 

[0290] Turning now to FIG. 13A, a document workspace 
screen 1310 from an EDMS 1210 is shown. In particular, 
document workspace screen 1310 shows multiple soft "file 
cabinets," wherein each "file cabinet" stores a different 
category of documents. In the typical operation of the 
EDMS 1210, a user may provide an input specifying one of 
tlie files 1222 on tlie document workspace screen 1310. hi 
general, the user may perform a mouse click to select a 
particular file 1222. In FIG. 13A, the document workspace 
screen 1310 lists several files in tlie riglit hand space that are 
identified by the DMT 1230 as required documentation. As 
specified above, these files may contain blank forms for the 
user to complete, instructions aiding the user in completmg 
the forms, or examples of completed foniis to which the user 
may refer when completing the blank form. 

[0291] Continuing with FIG. 12, APIF 1200 may fiulher 
include a navigator tool 1240 that graphically presents to the 
user the steps in Method 10 or other processes. In this way, 
tlie EDMS 1210 may be configured to llirther support 
integration of document management with a process control 
system. In particular, the navigator tool 1240 creates dis- 
plays using the data contained in the files 1222 based on the 
user's inputs. For instance the navigator tool 1240 he an 
application to create HTML pages whose contains are deter- 
mined by information in the files 1222. Likewise, the HTML 
pages may comain hyperlinks to tlie information in the files 
1222. The navigator tool 1240 generally functions through 
the use of navigator data 1250. In a preferred implementa- 
tion the navigator data 1250 is an XML data file containing 



information on file names, file types (or template), whether 
the file is a standard or modified template, the files' loca- 
tions, and other information specified by the user Alterna- 
tively, the navigator data 1250 may be a source table in a 
database or other type of data storage structure. Then, when 
creating the display, the navigator tool 1240 may access the 
appropriate file 1222 by referencing the navigator data 1250. 
The navigator data 1250 may be stored by the EDMS 1210 
along with the files 1222. If the files 1222 are positioned on 
a WAN, LAN; or SAN, the navigator data 1250 may be 
stored on this network as well. 

[0292] The use of the navigator tool 1240 is illustrated in 
FIGS. 13B-13 J. As depicted in a login screen 1320 in FIG. 
13B, a user, after logging into the EDMS 1210, may select 
different processes including, but not limited to, Method 10. 
Tlius, it should be appreciated tliat the navigator tool 1240 
may be integrated with the EDMS 1210 to assist the user in 
implementing various other projects and processes oflier 
than Method 10. 

[0293] Once tihie user selects a process to implement, the 
navigator tool 1240 accesses the EDMS 1210 to graphically 
display the selected process. After the user selects a project, 
tlie respective project page appears with the project name in 
the tool bar. The look and feel of the page produced by the 
navigator tool is generally similar to a standalone HTML 
Help-based tool. If only one project existed for the EDMS 
1210, the user may be would be taken directly to that 
project's home page (i.e., navigator screen 1330 described 
below), avoiding the login screen 1320. 

[0294] Turning now to FIG. 1 3C, a navigator screen 1330 
contains a higli-level, graphical depiction of Mefliod 10 and 
generally displays the stages in Method 10. Each of the 
stages in the navigator screen 1330 may be hyperiinked to 
more specific information on the stage. Thus, the user may 
obtain fiirther information and/or start implementing one of 
the stages in Method 10 by selecting a box corresponding to 
tliat stage. Continuing with FIG. 13C, the navigator screen 
1330 also graphically displays the relationship between the 
steps in a process so that the user may discern inlbmiation 
about the steps, such as their order and interrelation. Tlie 
navigator screen 1330 further contains, on the left column, 
an index of the steps and stages so tliat the user may easily 
navigate between steps in the process. Tliis ability is par- 
ticularly valuable in processes such as Method 10 that 
potentially require the user to simultaneously perform mul- 
tiple actions. 

[0295] As illustrated in FIG. 13D, a user's selection of 
one of the steps in the high-level process display in the 
navigator screen 1330 leads to a detail navigator screen 1340 
containing more detailed information on the selected step. 
Specifically, the detailed navigator screen 1340 lists the 
individual actions to be undertaken and the documentation 
to be completed by tlie user in that step. As with the 
navigator screen 1330, the detailed navigator screen 1340 
graphically displays the relationsliip between various 
actions and documentation. For instance, the user may see 
that a certain action must be undertaken before a dociunent 
may be completed and that other actions may not be initiated 
until completion of the dociunent. Again, one or more of the 
boxes in the detailed navigator screen 1340 may be hyper- 
linked to more specific information contained in the files 
1222. 
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[0296] For instance, the user's selection (or clicking) of a 
documentation box causes tlie navigator tool 1240 to pro- 
vide more information on that documentation. Specifically, 
the user's selection of a box to compose a document leads 
to a documentation screen 1350, as displayed in FIG. 13E. 
The displayed documentation screen 1350 may contain 
various uiformation, including a description of the document 
to be created, an indication of the step(s) of Method 10 
associated with the document, and samples of the document 
to be created. As indicated in the top center, tlie dociunen- 
tation screen 1350 in FIG. 13E may further contain "but- 
tons" or hyperlinked boxes that allow the user to start 
composing the document (or "deliverable"), to search for 
existing documents by type, and search for existing docu- 
ments by file storage location. 

[0297] If the user selects the button to compose a docu- 
ment or an equivalent thereof, the navigator tool 1240 
produces a composition screen 1360, as illustrated in FIG. 
13F. nie composition screen 1360 presents to the user a 
template for the dociuTient. The composition screen 1360 
generally allows the user to select a template for the docu- 
menl to be created and to specify a name for this the created 
document. In one implementation, a defaulted storage loca- 
tion, or "path." for the deliverable is determined according 
to the project and the template type. Specifically, a particular 
type of documents created for a project may be stored at a 
particular location. This feature allows the user to easily 
locate other examples of a document. When the user selects 
a template for a document, the navigator tool 1240 produces 
a template screen 1370, as displayed in FIG. 13G, to 
provide instruction and information to the user regarding the 
creation of the document. 

[0298] The user may also select the "View By Type" 
button iu the documentation screen 1350 of FIG. 13E. Tliis 
selection causes the navigator tool 1240 to create a list of all 
documents of a specific type (e.g., dociunents created from 
the same template) that are stored by the EDMS 1210. For 
instance, the type search screen 1380 in FIG. 13H displays 
files related to "project standards procedures policies." In 
this way, the user may locate examples of a document, even 
if these examples are associated with a different project or 
method or are located in different file storage locations. 
Conversely, the user may select the "View By Location" 
button in the documentation screen 1350 of FIG. 13E. In 
response, the navigator tool 1240 works with the EDMS 
1210 to create a list of documents at the specified location. 
As described above, similar documents related to a specific 
process are typically stored in single location. Searching 
files at a particular storage location thus generally allows the 
user to examine similar documents pertaining to tlie same 
project. In tlie location search screen 1385 in FIG. 131, the 
navigator tool 1240 displays files related to "project standard 
procedure policies" located at tlic path/project one/stage 
one/step one/document one. If the user knows the name and 
location for a file, the user may subsequently locate and view 
the file using the EDMS 1210, as depicted in the search 
screen 1390 in FIG. 13K. 

[0299] In another embodiment, as depicted in FIG. 14, a 
multiple repository APIF system 1400 distributes the docu- 
ments needed for the Method 10. As described above, these 
documents include, for example, instructions for implement- 
ing the Method 10 and documentation to evidence actions 
taken in the Method 10. Tlie multiple repository APIF 



system 1400 has a navigator application 1460 (described in 
greater detail below) that allows a user on the client-side to 
access documentation and data from multiple data reposi- 
tories 1440 through a server 1410. The data repositories 
1440 may have different formats and protocols and may be 
located at different locations. For instance, the data reposi- 
tories 1440 may be: (1) PVCS or other well known systems 
of version control and configuration management software; 
(2) a LAN; (3) an information sharing application, such as 
Sharepoint® by Microsoft Inc. of Redmond, Wash., that 
gives users the ability to organize information, readily 
access that information, manage documents, and enable 
efficient collaboration; or (4) the above-described EDMS 
application such as the Documentum. 
[0300] The server 1410 generally includes Active Server 
Pages (ASPs) 1420. ASPs 1420 is a specification for a 
dynamically created Web page witli a ".ASP" extension that 
utilizes ActiveX scripting, generally a VisualBasic Script or 
JavaScript code. When a browser requests an ASP page, the 
server 1410 generates a page with HTML code and sends it 
back to the browser. The operation of the ASPs 1420 is 
described in greater detail below. 

[0301] The server 1410 further includes a database engine 
1410. The database engine is well-known teclmology for 
organizing, locating, and accessing data contained in the 
data repositories 1440. Examples of the database engine 
include Oracle®, SQL Server®, and Access®. 
[0302] The components in the server 1410 use Web-based 
Distributed Authoring and Versioning (WebDAV) techonol- 
ogy 1450 to coordinate with the different data repositories 
1440. WebDAV 1450 is an extension to HyperText Transport 
Protocol (HTTP). Specifically, WebDAV" 1450 adds new 
HTTP methods and headers and specifies how to use the new 
extensions, how to format request and response bodies, how 
existing HTTP behavior may change, etc. 
[0303] HTTP is the standard mechanism by which infor- 
mation is transported over TCP/IP (Transmission Control 
Protocol/Internet Protocol) compatible networks, such as the 
Internet, intranets, and extranets. A protocol specifies what 
occurs in the comiections between a client and a server. 
Basically, the protocol specifies data fonnats and algoritlims 
so that the cUent and server can interoperate. HTTP is more 
specifically an application-level protocol for distributed, 
collaborative, hypermedia information systems. It is a 
generic, stateless, protocol tliat can be used for many tasks 
beyond its use for hypertext, such as name servers and 
distributed object management systems, through extension 
of its request metliods, error codes and headers. It is referred 
to as a transport protocol, since information is transported 
according to its specifications, and is also referred to as a 
request-response protocol, since information is exchanged 
by a client making a request of a server, which generates a 
response thereto. 

[0304] A common use of HTTP is the transport of infor- 
mation formatted according to a markup language. For 
example, a popular application of the Internet is the brows- 
ing of world-wide-web pages thereof In such instances, 
typically the infonnation retrieved is in HyperText Markup 
Language (HTML) format, as transported according to 
HTTP. However, other standard markup languages are 
emerging. One such markup language is extensible Markup 
Language (XML). XML describes a class of data objects that 
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are referred to as XML documents, and partially describes 
tlie behavior of computer programs that process them. A 
primary difference between HTML and XML is that within 
the former, information content is intertwined with the 
layout of the content, making their separation difficult, for 
example. Conversely, within XML a description of the 
storage layout and logical structure of content is maintained 
separate from the content itself. However, both XML and 
HTML are subsets of a markup language known as Standard 
Generalized Markup Language (SGML). 
[0305] HTTP, and hence XML in the context of IHTP, 
allows for the access of resources. Tlie term resource refers 
to any piece of information that has a location described by 
a Uniform Resource Locator (URL) of the form HTTP:// 
<domain>. <extension>, where <domain> specifies a par- 
ticular domain, and <extension> can be, for example, .com, 
.edu, and net, among others. A resource can be, for example, 
a Web page, a document, a database, a bitmap image, or a 
computational object. 

[03 06] Extensions to HTTP allow for, among other things, 
the setting and retrieval of properties for resources. A 
property is specifically a name/value pair that contains 
descriptive information about a resource. More generally, a 
propert>' is any information about a resource. Thus, proper- 
ties provide for the ability to create, remove, and query such 
information about resources, such as their authors, creation 
dates, etc. Properties also provide for the ability to link web 
pages of any media type to other related web pages. 

[0307] The goal of WebDAV 1450, broadly speaking, is to 
add remote authoring capabihties to HTTP, so that HTTP 
cjin be more convenient as a readable and writable collabo- 
rative medium, and not necessarily only a browsing medium 
for web pages. To achieve this goal, WebDAV allows an 
extended uniform set of ftmctionality to be attached with 
documents available tlirougli a web server. Thus, the Web- 
DAV 1450 protocol allows Web clients to create and edit 
documents over the Web. WebDAV 1450 also defines col- 
lections and a mechanism for associating arbitrary properties 
with resources. WebDAV 1450 also provides a means for 
creating typed hnks between any two documents, regardless 
of media type where previously, only HTML documents 
could contain links. 

[0308] WebD.W 1450 may operate as a remote file system 
with extra properties. Specifically, WebDAV extensions may 
be used to specify an access control list (ACL), a set of data 
that informs a computer's operating system which permis- 
sions, or access riglits, that each user or group has to specific 
system objects, such as directories and file. Each object can 
then have a unique security attribute that identifies which 
users have access to it, and the ACL is a list of each object 
and user access privileges such as read, write or execute. 

[0309] WebDAV 1 450 works with the file access system in 
an operating system, such as the Windows Explorer® in 
Microsoft Windows (D to allow a user to seamlessly access 
a remote storage device. 

[0310] Returning to FIG. 14, the operation of the multiple 
repository system 1400 is now suimnarized. In operation, a 
user at tlie client side uses the navigator application 1460 to 
access or create a document. The navigator 1460 works with 
Internet Explorer® browser. For instance, to access and 
view a document, the user provides some type of input (such 



as clicking on a desired button) to the navigator application 
1460 to specify the document to be viewed. Based on the 
input, the navigator 1460 forwards information to the ser\'er 
1410 identifying tlie document, such as name or type of the 
document, (he software project of interest, and the name of 
the server storing the document. In response, one of the 
ASPs 1420 accesses the database engine 1430 to locate the 
document named in the request. Then, ASP 1420 then 
connects the user to appropriate the data repository 1440 via 
WebDAV 1450. Typically, the user may view a web folder 
displaying the contents of the data repository 1440, from 
which the user may select a desired docmiient via WebDAV 
1450. 

[0311] Similarly, to compose a document tluougli a stored 
template, the user specifies the document to be created 
through the navigator application 1460. In turn, the naviga- 
tor application 1460 forwards to the server 1410 iufomiation 
identifying the document. For instance, tlie navigator 1460 
may forward the name of the document, the project of 
interest, and server storing the document. In response, one of 
the ASPs 1420 accesses the database engine 1430 to locate 
the desired template. The ASP 1420 further creates an entry 
in the database engine 1430 for the document to be created. 
The name of the template is then used to build a location for 
the template, typically in the fonn of a URL. One of the 
ASPs 1420 then copies a template from the data repository 
to a target folder using WebDAV 1450. An ASP 1420 then 
forwards a page to the navigator 1460 displaying the target 
folder with the new document. Tlie user may then open the 
document througli the navigator 1450 to view and edit the 
template. The navigator 1460 may then forward the docu- 
ment to one of tlie repositories 1440 via WebDAV 1450. The 
database engine 1430 then stores the location for the stored 
document. 

CONCLUSION 

[0312] The CMM method of the present invention has 
been empirically shown to allow organizations to achieve 
higher levels of CMM hierarchy much more rapidly. On 
average, an organization or a project within an organization 
takes about three years to achieve compliance witli level 3 
of the CMM. In contrast, several projects implementing the 
CMM in a BOX metliod 10 of the present invention have 
reached level 3 of the CMM in an average of nine months. 
These results suggest the utility and benefit of the present 
invention in assisting organizations to acliieve higher levels 
of CMM maturity. 

[0313] The foregoing description of the preferred embodi- 
ments of the invention has been presented for the puiposes 
of illustration and description. It is not intended to be 
exhaustive or to limit the invention to the precise form 
disclosed. Many modifications and variations are possible in 
light of tlie above teaching. For instance, the metliod of the 
present uivention may be modified as needed to meet the 
requirements of new versions of CMM and other maturity 
models as they are developed. It is intended that the scope 
of the invention be limited not by this detailed description, 
but rather by the claims appended hereto. Tlie above speci- 
fication, examples, and data provide a complete description 
of the manufacture and use of the composition of the 
invention. Since many embodiments of the invention can be 
made without departing from the spirit and scope of the 
invention, the invention resides in the claims hereinafter 
appended. 
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TABLE 1 



(Navigator Item) Type 



SEPG Work Plan 



Tie SEPG Project Plan serves as a 
guideline for defining, measuring, and 
monitoring commitment to quality by all 
team membeis on a project. It also 
identifies the key project mles, 
responsibilities, and personnel, and houses 



The Decision Analysis and Resolution 
(DAR) reference document defines DAR 
and its value, explains the puipose of DAR, 
identifies typical decisions requiring DAR, 
describes DAR techniques and artifacts, and 
provides guidelines for selecting the 



itlines the process that all 
follow when perfbraiing DAR. 
le DAR reference document 



resources available for resolving and 
analyzing project decisions during all 
phases of an organization's application 
lifecycle. Included are sample artifacts 
may be ciealBd when using DAR. 
The SEPG Work Plan describes 
deliverables to be produced, the 
be performed, the estimated effort ret 
key completion dates. They are prodi 

of a preceding phase of work, or duri 



key 



Resources 
Control SEPG 

Plan SEPG 



Communication and Sponsorship Plan 
serves as a guide to the communication and 
sponsorship efforts throughout the duration 
of the project. 

The Communication and Sponsorship Plan 
serves as a guide to the communication and 
sponsorship eflForts duoughout die duration 
of die project. It is a living and working 
nt and should be updated 




function wil 
guidance needed to support the deliveiy oi 
targeted business capabilities, hnplementing 



The purpose of Risk Management Planning 
is to focus attention on minimizing threats in 
the achievement of project objectives. It will 
provide a systematic approach for 
identifying and assessing risks, detemiiniiig 
cost-effective risk reductions, and 
monitoring and reporting progress in 



Control SEPG 
Project Work 
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TABLE 1 -continued 



Training Needs Template 
Matrix (sliadcd for 



CMMI Awarene 
for Sponsors 
Training 



Quality Reviews Training 



Description 

reducing rislc. All projects must perfonn risk 
planning in order to achieve Risk 
Management Planning objectives. Large 
projects sbould create a formal Risk 
Management Plan, but smaller projects 
need only to incorporate their risk planning 
into the Project Plan. 

The Training Needs Matrix lists the required 
training by role on a project, and describes 
the format of each training. It is used as a 
guide in identifying training needs, and as a 
tracking m 



training required to fulfill t 
The Orientation Binder act 
of information for a new te 
topics and infonnation provided within the 
bmder will help the new member get 



Projects are required to 
binders to hold the in" 
the orientation binder template i 



The 



applicable project information. 
The SEPG Project Processes & Policies 
Table of Contents documents the project's 
formalized policies, standards, and 
processes. It also indicates the policies, 
standards, and processes that the project is 
required to develop. 

This Project Processes & Policies document 
is used to record standards and procedures 
that are specific to a project. Such 
documents would include the Issue Tracking 
Process, Risk Tracking Process, New 
Process Definition Process, all development 
and testing procedures, etc. See attached 
samples as a starting point for developing 



f Navigator Item. 



The CMMI 
presentation 



:signed to help trs 



and its benefits, understand CMMI Level 2 

CMMI Level 3 concepts and examples. This 
Training pertains to the Capability Maturity 
Model - Integrated (CMMI) framework. 
CMM in a Box is based on Uie CMMI 
framework. 

The CMMI Awareness for Sponsors Training 
is a presentation designed to help sponsors 
id the CMMI framework and its 
id CMMI Level 2 

CMMI Level 3 
The SEPG Program Overview is a brief 
presentation designed to help the training 
attendees understand CMMI and why it is 
important to the organization as well as 
understand how the SEPG supports the 
CMMI. 

The Quality Reviews Training provides 
attendees witli a definition and purpose fo 
the Software Quality Assurance and Peer 



Navigator Navigator Item. 

Process Organize SEPG 

Resources 



Organize SEPG 
Resources 



Quality Review, and 
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TABLE 1 -continued 



Metrics TTaining Trainmg 

Document Reference 
Repository Document 



Tlie Metrics Training will help projects to 
implement metrics. 

The Document Repository Overview defii 



generally problems that in 



le, the impact, priority, status and 



impact, mitigation approac 



All Stages All Task 



tlie purpose and content of a meeting, as 
well as any key meeting outcomes and 

Individual and'or Team Status Reports 
contain status information from each team 
member, or for the entire team. This will list 
accomplishments for the week, tasks for 
next week, issues, and oUier infonnation 
that may be appropriate for status 




periodic basis as established in the 
Configuration Management Plan. 
See first occurrence of Navigator Iter 
Process Plan and Organize SEPG Sta 



and Organize Organize SEPG 
SEPG Stage. Stage. 
See first See first 



Item at the at the Process 

Process Plan Plan and 

and Organize Organize SEPG 

SEPG Stage. Stage. 
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TABLE 1 -continued 



ss Plan and Oiganize SEPG Stage. 



Configuration 
Management Pla 
(shaded foi updi 



Navigator Item 
K SEPG 



SEPG Stage. Stage. 



Oxgajiize SEPG 



requirements between a 
and the Soihvare Engineering 
Group (SEPG). This document i 
id to the project manager who m 



Engagera 



'Of the Project 
projecl 



ts. The Service 
Ics an overview of 
support 
execution of SEPG eBbrts. 
The Tailoring & Waiver Request template 
provides guidance on how a project can 



;, ifyo 



Metrics Worldjook 



required by the Project Team. The project 
must complete the Metrics Worktwok on a 
monthly basis and submit it to the SEPG 
team lead. Tlie Metrics Plan outlines tlie 
overall metrics program and provides 
detailed explanations for each metric 
included in the Metrics Workbook. 
The Metrics Plan describes the overall 
approach for identifying, collecting, and 
analyzing delivery metrics. Projects must 
use this document to plan for dieir metrics. 
The purpose of the document is to provide 



Rollout & 
Support 

Plan Project 
Execution 
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TABLE 1 -continued 



SQA Debrief Reference 



summarize the project This memo should 
include project results, pertinent project 
metrics including schedule and budget plan 

project shortcomings. 

The Software Quality Assurance (SQA) 

Debrief is conducted at the end of the 

;t. During this meeting, tlie Software 



Rollout & 



le SQA Debrief are used ti 



Super SQA Training Training 



=r SQA Reviewer Training is 



Process Conduct Super 



lA Report Template 



nvolved in a Super SQA Revi 



CMM Best Practices matrix. The SQA 



nt Schedule for *e 

od (OSP), usual^ last 5-l( 



Process Conduct 



Mini-Appraisal Plan Template 



sses back to th 
Capability Maturity Model - Integrated 
(CMMI). This schedule sample outlines a 
generic OSP agenda. 
The Logistics Sample document can be 



building access ii 



a participant list for thi 

;paration Training 
outline that includes th 
; & CK-erview, Roles & 
s, Interviews Do's & Don'ls, 



s. Interview Questions, 
Schedule 

Logistics, and Questions. 

The purpose of tlie Participant Information 

Sheet is to set expectations of die 

Its as they prepare for 



The purpose of this plan is to outline 
mini-appraisal process fo 
This plan documents tlie goals, objectives 



Process Conduct 



Process Conduct 
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TABLE 1 -continued 



Improvement 



expected outcomes, scope, ps 
schedule, and logistics of the evaluation, it 
also specifies the tailoring of the Standard 
CMMI Assessment Method for Process 
Impmvement method for the purposes of the 
mini-appraisal. 

The Process Improvement Survey should be 
distributed to all participants to gather 
infoimation regarding their experience with 
the Software Engineering Process Group 
(SEPG). The information gatliered from this 
sun'ey should be used as an input in 
improving the processes of the Software 
Process Engineering Group. 
Tlie purpose of the Organization Design and 
Development (OD&D)Toolkit is to help 
create, modify, and/or develop organization 

needs. Depending on the scope of the 
organization design and development 
initiative, some or all of the information can 
be used to facilitate the initiative. The steps 
within tlie toolkit provide guidance in 




Conduct 
Quarterly 



Infrastructure 
Determine 



ompetencies Template 



Design and Development process. A 
competency is a cluster of related 
knowledge, skills, and other 
attributes/abilities associated with high 



id Development 

; should be produced 



Think of th. 



Id be used as guidelines. 



strategy. The guiding principles i 
general list or broken into broad 
See firet occurrence of Navigato) 
Identify Oiganization Strategy. 



Navigator Item 
in Identify 
Organization 



The Gap Analysis works 
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TABLE 1-continued 



Competency Model Template 



The Competency Model begins with the 
Competency Model Name module with the 
name of the Team Lead. The next module. 
Team Lead Competency Model, contains a 



Stage Step 

Identily Oiganization 
Oiganization Strategy. 

Peisonnel Design 

Infrastructuie 



he competency definitions, and the requi 
roficiency levels for all competencies. Tl 
LSt module. Proficiency Scale, contains a 
Lbie that illustrates the proficiency level £ 
orresponding behavioral indicators for thi 
roblem-solving competency. 



Preliminary Job Template 



Organizational 
Design & 
Development 
Toolkit 



Design and Development Toolkit. 
A job is a group of related roles that defines 
an individual's place within the oiganization. 
The oiganization design initiative is only 
tasked with cieating the preliminary job 
description. The final job description will be 
developed by the oSces after 
hnplementation based on the level of the 
employees assigned to each pc 



esign ofUiecc 

found in the Organization Design and 
Development Toolkit. 

This sample document outlines ihe different 

Organizational Stnicture T^qies and 

provides samples of each. These include 

Functional, Process, Product, Matrix, and 

Customer/Industo'-focused- 

See first occurrence of Navigator Item in 

Identily Organization Strategy. 



Organization 
Infrastnjchire 



Identify 
Organizatior 



Preliminary Job 
Description (shaded 



Navigator Item 
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Performance 
Management 
Infrastructure 



OrganizationaJ 
Design & 
Development 



The Training Toolkit will help plan and 
deliver training to the audience(s) who wil 

help people to perform tlieir roles effective 
and efficiently. The training taik for each 
new initiative is a critical component of 
preparing employees for change. The 
Training Toolkit is intended to provide 
guidance on developing training to "gel 
people started" and to explain "what's ne\ 



Navigator Item 
Organization 



Devellop 
Training Flan 



Tlie Trai 



ing on the newly de 

amg Needs Analysis course is us 
to prepare instructors for the needs of 
affected training audiences. It includes a 
liigh level training needs analysis by 
audience ox group and a more detailed 
analysis for individuals. 
See fust occurrence of Navigator Item in 
Conduct Training Needs Analysis. 



See first 

occurrence of 
Navigator Item 



The Training Plan course is used to prepare 

It includes training approach, course 
curriculum, and module descriptions. 
See first occurrence of Navigator Item in 
Conduct Training Needs Analysis. 



The purpose of the Training Developme 
Standards is to ensure that traming 
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(Navigator Item) Type 



Instructor Guide Template 



Participant Guide Template 
Training Toolkit Template 



The In 

insmictors to teach a particulai 
includes a course overvi 
objectives, prerequisites, and topic timing. 

The template is organized ia modules diat 
walk the instructor through entire couise 

The Participant Guide is used lo provide 



Navigator It« 



The Train-the-Trainer course is used to 
prepare instructois to teach a particular 
Course. The Course Description defines the 
objectives, pte-iequisites, expectations, 
length, and agenda for the training course. 
" " ' ce of Navigator Item in 



The Sign-In Sheet d( 



le Develop 
ng Toolkit for 



with the Develop Training section of die 
Training Toolkit. Reference the Develop 
Training section of the Training Toolkit for 
additional background infoimation regarding 
the Course Evaluation. 



seBist 

Conduct Training Needs Analysis. 



Navigator Item 



m Conduct 
TramingNeec 



Training Toolkit Template 
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Navigator 



Navigator Itsm 
Training Needs 



re of the Program Business 
estimating, documenting, an 



Management 



with the jmpietnencation of projects ar 
defines a process to ensure that all bus 



acioss projects. And last, it defines tlie 
processes for reviewing and submitting the 
business cases. This process is applicable 
to all programs and subordinate projects. 
Template and The Program Business Case is to be used 
Sample in conjunction with the Program Business 

Case Approach and the Program Business 
Case Sample. This document is to be used 
as a template for building a business case 
while the Program Business Case S.'unple 
document provides an example of what tlie 
actual Business Case should look like. This 



id well-d( 



Program 
Manage] 
Approach 



when operating the program office. This 



guidance when developing tlie Program 
Plan. 

The Program Plan defines the overall 



Oiganize 
Program 
Resources 
Control 



Management 

Program 

Managemenl 



Performance 
Reporting Approach 



mofUie 

overall program and each project's 
performance and progress against the plan. 
Project status reporting and team member 
time reporting are critical functions within 
this process. The purpose of tliis 
deliverable is to develop the Performance 
Reporting process and to record any fiiture 
changes in direction, scope, or timeframes. 
This document defines the financial controls 
and processes for the program, including 
financial man.agenienr and reporting. 
The Program Resource Management Plan 

managing tlie program's human and 
pliysical resources. The objectives include 



Program Work 
Plan Program 
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Document Name 



releasing human and physical resoui 
required by the individual project te 
the program, as well as to provide 



Management Program Work 



Program Release 

Management 

Approach 



agement approach for defining, 
> and delivering releases. Release 
ment is responsible for defining and 
ig the individual releases as well as 
:ndencies and interfaces between 
. Although the techniques 
:d in these guidelines are particularly 
)le to large, long-term programs of 



Management 
Approach 

Program Resource 
Management Plan 
(shaded for update) 



See first occurrence of Navi 



lie purpose of the Program Rcsoin-cc 



occurrence 
Navigation 



PrograiTi Resource Template 
Management Plan 
(shaded for update) 

Program Business Template 
Case (shaded for 



Approach 



s of the final disposition of all human 
ihysical resomces ajid describes the 
^ed location of all historical program 
ds that are captured. 
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Template and The O 



to the coinmimi( 



le project. It is a living and working 
document and should be updated 
periodically as audience needs change. 
The estimating process applies the cost 
Tactors against the tailored work plan to 
produce an estimate of the effort that will t 



Stage Step 



Upon completing a projec 



allow future es 
The Configujat 
applies to all information syst 
related system engineering aci 

effoil. This would include liai 
software (COTS and/or custoi 
dociunenlation. In particular, i 



configiu-ation 



leed for a configuration 

verall technical and function: 
he program. This enterprise 

livery of targeted business 
iplementiiig a configuration 

vitk oversight ability. 
The purpose of Risk Management Planning 
is to focus attention on minimizing threats 
the achiex'ement of project objectives. It wi 



Project Plan Project 



nning in order to achieve Risk 
magement Planning objectives. Large 



I a project, and describes die 
ining. It is used as a guide 
ling needs, and as a tracking 
□re that project team 



required to fulfill their roles. 
The Project Metrics Workbook template is 
used as a central repository for the metrics 
required by the Project Team. The project 
must complete the Metrics Workbook on a 
monthly basis and submit it to the SEPG team 



Organize 

Resources 
Control Project 



Metrics Workbook. 
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Document Name 
(Navigator Item) 

Project Plan 

Project Processes 
& Policies Table of 



Training Needs 
Matrix (shaded foi 
update) 



The Pmject Processes & Policies Table of 
Contents documents the project's foimalized 
policies, standaids, and processes. It also 
indicates the policies, standards, and 
processes diat the project is required to 

This document is used to record standaids 
and procedures that are specific to a project. 
Such documents would include the Issue 
Tracking Process, Risk Tracking Process, 
New Process Definition Process, all 
development and testing procedures, etc. 
See attached samples as a starting point for 
developing project-specific processes. 



Issue Management is the process of 
reconling, tracking and resolving issues tha 
are impacting the project. Issues are 
generally problems that involve a significan 

an event that is happening now. Projects 



Navigator Navigator Item. 



The Meeting Minutes/Agent 
purpose and content of a m< 
any key meeting outcomes i 



Control Project 
Work 

Control Project 



Training Needs 
Matrix (shaded for 
update) 



Control Project 
Work 

Control Project 
Navigator Item. 



corrective actions for those discrepancies. The 
three main components of tlie audit template 
describe tlie project infomiation, lists tlie 
components audited, and lists the findings 
resulting from the audit. All discrepancies 



Project Control Project 

Management Work 
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Project Plajl 
(shaded for 
update) 



See Brst See first 

Navigator Navigator Item. 

occurrence of 



summarize the project This memo should 
include project results, pertinent project 
metrics including schedule and budget plan 
versus actual, project successes, and project 



occurrence of occurrence of 



The Software Quality Assurance (SQA) 
Report lists deviations in standard processes 
and deliverables as listed on the CMM Best 
Practices matrix. The SQA Reviewer 
produces this document as a result of the 

The Business Case provides economic 
justification for the change joiuney and for 
each program witllin the change journey. The 
Business Case explains why the sponsoring 

receives by changing, and what steps aie 
necessary for a successful change. The 
Business Case addresses three main 
components: (1) business context and change 
imperatives, P) value impact analysis, and (3) 



The Current Business Assessment allows for 
reviewing of the existing system. This makes 
it possible to identify potential reusable 



objective is to describe "what needs to be 
done and/or achieved" and includes general 

business rules, llinctions, process flows, and 



(shaded for update) 



The New Bus 
identifies the number c 



See first occurrence of Navigator Item. 
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in Delivery Task 



Moved to Commit design m 
Moved to Commit design m 



Requirements Template 



The Application and Interface Requirements 
document describes the application and 
interface requirements. It is a further 
■ ■ m of the bus- 



le requirements traceability 



Identify and 
Application and 



Execution.'Operatians Template 



Development Template 



Technology Template 



Traceability Matrix 



component(s) oi 

The User and Service Level R< _ 
document describes the users that the 
solution will support. It also lists die buf 

handle as well as required response time 
The Execution/Operations Architecmre i 
collection of services and control stmctu 
that support die solution. It is an intermi 
layer between die application and die 
operating system software. The 
Execudon/Operations Architecture 
Requirement!: deliverable lists Uie 
ts for die exe. 



ion/operations 



requirements for the technology infiastmctiire, 
lists options for satisfying each requirement 
category and lists die recommended solution 
including the rationale for its selection. 
The purpose of die development architecture 
' sks involved in die analysis, 



The Technology Infrastructure Scope consists 
of a graphical representation of die scope of 
the technology inftastmcmre. It depicts the 



Interface 
Requirements 
Control Project 



Technology 
Infrastructure 



Executiott'Operations 
Component Design 



ssaiy to enable the business objecdves. 
document should oudine die general 
gn for the execution, development and 



id interfaces necessary fo 



Architecture 
Select and 

Execution/Operation 
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Execution/Operations Template 



Execution/Operations Template 
Aichitectuie Test 



The Execution/Operations Arehitecture 

comprising the execution/operations 
architecture and their relative location and 
interfaces. Interfaces across architectures 
should also be reflected (e.g., operations 
architecture interfaces to execution). 
Moreover, the model will depict the platforms 
on which the components will reside as well 




The Execution/Operations A 

" be the conditions by which 

Jl be tested. The conditions 
£ architecture requirements. 




Build and 
Test 



Execution/Operations 
Select and 

Execution/Opemtions 



Execution/Operations 



Execution/Operations Template 



(Shaded for update) 



Development Template 
Physical Model 



conditions. The di 
with the test scrip! 
conditions are beii 
required. 




A document should 
ivelopment architecture 
component deliverable. 

The Development Aiohitecmre Physical Model 
shows the actual components comprising the 
development architecture and their relative 
location and inteifaces. Interfaces ac 



operations 

development). Moret 
depict die platfonns 
will reside as wl 



=d (e.g., 



Select and 
Development 
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Development Template 



Development Template 
Architecture Test 



Development Template 



Conceptual Design Template 



This Delive 
stages involved in testing. A Testing 
Approach consists of Test Objectives and 
Scope, Test Overview, Deficiency Tracking 
Approach, Regression Testing Approach, Test 
Environment, and Risk Management. 



The Develop] 



map directly to the architei 
The Development Ai 

define the steps to be lollowed by the lesliiij 
identified. The scripts are instnictions that at 



The Development Architecmie Test Results 
describe the actual results of tlie test and any 
issues or lessons learned ftom the test effort. 



The Development Architecture Test Data is 
the data used as input to test the conditions. 
Tlie data is used in conjunction with tlie test 
scripts to validate that the conditions are being 
met acciu-ately and as required. 



The Conceptual Design deli 
called the operational conce 
key functional and interface 
the work product. This document address 
the design method, fimcdouai and data 



The General Design deliverable describ 



Build and 
Test 



Development 



Build and Test 

Technology 

Infrastructure 

Select and 



id Test 



Build and Test 



re packets of grouping 



Items displayed include Inputs, Outputs, 
Fluictional Description, and Interfaces. 
The Interface Agreement describes the 



:ies de\'eloping the various luiits. This 
verable addresses the handling of change 
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The Interface Design Approach is used to 
outline the process of transferring data in and 
out of a system. It should include the following 

Tnterfece Execution - The ability to launch 
interface processes and record information 
about the processing of those interfaces. 
File Transfer - A metliod to transfer tlie file 



Assembly Test Plan Template 



Assembly Test Template 



Assembly Test Template 
Results 

Assembly Test Data Template 

Logical Data Model Tool 

Data Dictionary Template 

Database None 
Configuration 

Database Definition Template 

Database Space Template 



Restait'Recovery - The ability to restart ai 
interface that encountered errors during 



The Assembly Test Plan documents the 
specific steps in the testing process. It 
includes descriptions of the test processes or 
passes, the cycle definitions, tlic phase 
contaijunent criteria, tlie use of the testing 
database and configuration management for 

The Assembly Test Conditions describe the 
conditions by which the component will be 
tested. The conditions map directly to the 



The Assembly Test Scripts define the steps to 
be followed by tlie testing exeoitor to test tlie 
conditions that have been identified. The 
scripts are instmctions that arc clear, 
unambiguous and repealable in manner. 
The Assembly Test Results describe the 
actual results of the test and any issues or 
lessons learned from the test effort. 



The Assembly Test Data i: 



the conditions are beuig met accurately and 

The fiist iteration of database design for a 
system. This model includes the entities, keys 
and relationships as well as a first cut at 
attributes. This deliverable is typically 
developed using data modeling tools such as 




locations for 
This document identifies a database, which 
makes up part of the Physical Database 
Design. It captures the key aspects of the 
database, such as die various components: 
tables, indexes, views, and tablespaces. 
Optionally, it may include description of the 
disk configuration, sizings, placement, and 
segment management strategies. Create this 
document as an entry point for referenci 
at belong to this datat 
■ liltiie 



all 



calculate 
>ase. The 
for calculating tlie space 



Architecture 
Build and Test 
Application 

Application 



Build & Test Build and Test 
Application 

Design Design 

Application 



Build & Test Build and Test 
Application 

Design Design 

Application 
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Tlie Database to File System Mapping 
rioCTiment defines tlie sizing estimates for 
application data as well as £>r the databas 
Its that facilitate rollback and 




template to document 
infomiation to docume 
Strategy, Data Paititioi 
Freespace Strategy, aiK 
The Conversion Proce; 



(shaded for update) 



strategies and timelines for delivering diat 
functionality, and the impacts to die 
organization will outline die rollout segment. 
Data conversion will be covered by identifying 
what data needs to be converted, along with 
outlining the procedures diat will be followed 
in converting that data and die controls diat 
will be in place to ensure the quality and 



The Execution/Operatic 
is a spreadsheet 
Execution Archil 



tracks die inventory of 



Technology 
Infrastructin-e 



Build and Test 
Execution/ 
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Kxeciitinn/Openirions Template 

Arehitecture Test 

Plan 

(shaded foi update) 



Operations 



ution/Operations Template 
itecture Test 

(shaded for update) 



Navigator Iten 
Technology 



Executiott'Opeiations Template 
(shaded for update) 



Execution/Operation; 



Design Technology Infrastructure design 



(sliaded for update) 

Development 
Detailed Design 

Architecture Guide 

Development 
Architecture Test 
Plan 

(shaded for update) 



velopment Aichitecmre Detail Design 
to document the detailed design 
alions for the development ardlitecture 



spreadsheet, which tracks the inventory of 
Development Architecture components. 
See Rist occurrence of Navigator Item in 
Design Technology Infrastructure design 



Navigator Item 



Technology 
Infrastructure 



Technology 
Infrastructure 



Item in in Design 

Design Tecluiology 

Technology Infrastrucnire 

Infrastructure design matrix. 

See first See first 

Navigator Navigator Item 
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occurrence o 
Navigaror 



Technology 
Inf/Astructuie 



Operations Manual Template 



Deployment Test Template 



the business capabilities. 
This documents the g;uiding principles of the 
operational environment. Typically this 
document would describe responsibilities, 



intended to reduce confusion and provide 
assistance in recovering the business 
functions as quickly as possible. 
Tlie Deployment Test Plan docuiiieuts tlie 
specific steps in the deployment test process. 



design matrix. 
Build & Test Deployment 



Id & Test Deployment 



Deployment Test Template 



The Deployment Test Conditions describe the 



Deployment Test Template 



Deployment Test Template 



Deployment Test Template 



The Deploym 
to be followe 



nt Test S< 



ne the steps 



; been identified. The 
scripts are instructions that are clear, 
unambiguous and repeatable in manner. 
The Deployment Test Results describe the 
actual results of the test and any issues or 
lessons learned from the test effort. 



The Deployment Test Data is tlie data used as 
conjunction widi the test scripts to validate tliat 



ill include standard 



ct list or a technical 



flows and any general design changes will b( 
included. A document describing expected 
results and space to provide actual lesuits wi 



Verify 

Build & Test Deployment 
Planning 

Deployment .Activate and 
Verify 
Deployment 

Build & Test Deployment 



Verify 
Deployment 



Build & Test 
Build & Test 
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(Navigator Item) Type 



Agreement (shaded 



The Sepoit Detail Design provides an 
overview of the components necessary for 
creating reports. There exist notes for the 
programmer, including general design 
changes. There are process flows that 
describe how the reports are created, such as, 
where the information comes from tliat 
populates the reports, the format of the report 
and the program(s) used to create the reports. 
Information describing how often the reports 
are produced (daily, weekly, monthly, etc.) 



See first occurrence of navigator it 
Design Application stage. 



e See first See 



» Detail Design provides an 



their functionality. There exists a process 
flow diat visvially shows each component ai 
how the components fit together. There is a 



Build & Test Perform 

Application 
Detailed Design 



Component Test Template 



Build & Test 
Build & Test 



3mponent Test Template 



The Component Test Conditions desci 
conditions by which the component w 
tested. The conditions map directly to 



The Component Test Scripts define die steps 
to be followed by the testing executor to test 
the conditions tliat have been identified. The 



lambiguous and repealable in manner, 
le Component Test Results describe Uk 
tual results of the test and any issues c 



Build & Test Build & Test 
Application 

Build & Test Perform 

Application 
Detailed Design 

Build & Test Build & Test 
.Application 

Build & Test Perform 

Application 
Detailed Design 

Build & Test Build & Test 
Application 

Build & Test Perform 



Component Test Template 



Source Code Template 



The Component Test D.nta i; 



Documents the SQL that is utilized to access 
one or more databases from multiple location: 
Shells are tlie coding templates used for 
stored procedures or functions so that all codi 



Build & Test Build & Test 
Application 

Build & Test Perfonn 

Application 
Detailed Design 



Source Code is developed fo 



us 2006/0235732 Al 



60 



Oct. 19, 2006 



TABLE 1 -continued 



(Navigator Item) Type 



Component Test 
Plan 

(shaded for update) 
Componem Test 

(shaded for update] 



(shaded for update) 



(shaded for update) 



Template See fiist occurrence of Navigator Item. 

Template See first occurrence of Navigator Item. 

Template See fiist occurrence of Navigator Item. 

Template See first occurrence of Navigator Item. 

Template See first occurrence of Navigator Item. 



Business Policies & Template 



(procedures). Bu.siness policit 
procedures often drive creati( 
procedures, or step-by-step ii 



Assembly Test 
Scripts(sliaded fo: 
update) 



design matrix. 



Assembly Test 
(shaded for update) 



(shaded for update) 



Navigator Item 
in Design 
Application 
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Product Test Plan Template The Product Test Plan documents the specific 



Application 
Product Test 



Product Test Data Template 



tested. The conditions map directly to the 
application and interface requirements. 
The Product Test Scripts define lire steps to 

conditions that have been identified. The 



ThePr 



,ct Test Data is tlie data u 



input to test the conditions. The data is used ii 
conjunction witli the test scripts to validate tha 
the conditions are being met accurately and 
as required. 

See first occurrence of navigator item in 
Project Management stage design matrix. 



Product Test 

Prepare & 

Application 
Product Test 
Prepare & 

Application 



er Acceptance Template 



The User Acceptance Test Plan documents 
the specific steps in the testing process. It 
includes descriptions of Uie lesl processes or 



stage design 
Build & Test 



User Acceptance Template 



directly to die user requirements. 
The User Acceptance Test Scripts define the 
steps to be followed by the testing executor to 
test the conditions tliat have been identified. 



Id & Test Prepare & 



ice Test Results de.scribe 
f the test and any Issues or 
m die test eftort. 



Project Management st 



Build & Test Prep 



Deployment Test 
Plan (shaded for 



stage design 



us 2006/0235732 Al 



62 



Oct. 19, 2006 



TABLE 1 -continued 



Deployment Test Template 
Conditions (shaded 
for update) 



»uild & Test App design m 



Template See firat oc 



Build & Test App design m 



item on the oo the Buik 
Build & Test Test App 
App design design imtr 



Deployment Test 
DaU (shaded for 



Statement of Work 



subcontractois. This deliverable should be 

subctintractore' ability to satisfy the selection 

llle subselection process is an orderly, well- 
defined process, that leads to a "best-fit" and 
best vahie" siibcontraclor saliii 



the 



Tlie Subcontractor Management Plan 
captures all activities relating to tlie project's 
management of subcontractors. The plan 
serves as a guideline to assist project 
management in delining, measuring, and 
monitoring commitment to quality by all 
subcontractois assigned to the projea. This 
plan is not intended for subcontractors who 
will work directly on the project team. 
Subcontractois that function as part of the 
project team should be addressed in the 
project plan. 

The project should use this space to store the 



Project Management stage design mi 



Supplier Plan 
Agreement Subcontractor 
Management Management 



Management 
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will be tested. The 



iptance Test Conditions 



)e followed by the te 



:s. The d 



Performance Test 



validate that the conditions are being met 
accurately and as required. 
The Product Performance Test Plan 
documents the specific steps used by tlie 
project to ensure the performance of the 
product meets the specified requirements. 
The Product Performance Test Conditions 
describe the conditions by which die 
component will be tested. The conditions map 
directly to the product selection criteria. 
The Product Performance Test Scripts define 
the steps to be followed by the lEsting 
executor to test the conditions that have been 
identified. The scripts are instructions that are 



Man! 

Supplier Control Product 

Agreement Acquisition 
Management 

Supplier Control Product 

Agreement Acquisition 
Management 



Control Product 



The Product Performance Test Results 
describe the actual results of the test and any 
issues or lessons learned from the test effort. 
The Product Perform.-mce Test Data is the 



pplier Control Product 



Project Management sti 



of Navigator Item in 



The Tracking Tool Installation Guide outlines 
the steps to take when installing any of the 
various tracking tools including the Issues, 
Risk, and SIRs/CRs tools. 
The SEPG Project Processes & Policies 
document is used to record standards and 
procedures that are specific to a project. Such 
documents would include the Issue Tracking 
Process, Risk Tracking Process. New Process 
Definition Process, all development and 

samples as a starting point for developing 



Management stage design 
stage design matrix. 



esigned to help training 
!rstand tlie C.MM framework 
s, undeistand CMM Level 2 
sxamples, and understand 
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CMMI for Spoiisore Training 



CMM Level 3 concepts and examples. This 
Training pertains to the Capability Maturity 
Model (CMM) for Software only, not to CMM- 
Integrated (CMMI) 



the CMM for Software. CMM in a Box is 
based on the CMMI framewoik. 
The CMM to CMMI Transition Tiaining is a 
presentation that focuses on the transition 
from the Capability Maturity Model (CMM) for 
Software to CMM - Integrated (CMMI). The 
training provides generic examples of the 
difference between the models and what new 
processes have been added to CMMI. CMM 
in a Box is based on the CMMI framework. It 
is designed to help the training attendees 
understand the transition from Capability 
Maturity Model (CMM) to Capability Maturity 
Model - Integrated (CMMI) and how the new 
CMMI requirements are being implemented 
within the organization. 
The CMMI Awareness for Sponsors Training 
is a presentation designed to help sponsois 
understand the CMMI framework and its 
benefits, understand CMMI Level 2 concepts 
and examples, and understand CMMI Level 3 
concepts and examples. 
This purpose of the Tracking Tool Design 
document is to provide design information for 
projects who wish to customize the tracking 
tools. The primary audience would be the 



Change Request (CR) Tiackiiii 
Tliis document is included on 
reference purposes only. The p 



m this page, go to 
'fi if you need a 
jurpose of this 



opy of this document. The 
ervice Level Agreement is 



between a project and the Software 
Engineering Process Group (SEPG). This 
document is presented to the project manager 
who must agree to and sign before a 
substantive SEPG support commences. The 
SEPG will distribute a copy of the Service 
Level Agreement to the Engagement Partner, 
while it is the responsibility of the Project 
Manager to distribute/educate project team 
members on die contents. The Service Level 



Rollout & 



Tailoring & Waiver Reference 



icludes guidelines on policy, i 
eliverable. and tool tailoring. 
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TABLE 1-continued 



Metrics Workbook 




poses only- The proj 
3r completing tliese i 
Do not download or save from this page, go to 
the Project Management Stage if you need a 
copy of this document. 
The Project Metrics Workbook template is 
used as a central repository for the metrics 
required by the Project Team. The project 
must complete the Metrics Workbook on a 
monthly basis and submit it to the SEPG team 



Process Rollout & 



Rollout & 
Support 



approach for identifying, collecting, and 
analyzing delivery metrics. Projects must u 
this document to plan for their metrics. 
This document is included on the page for 
reference purposes only. The projects ai 



Process Rollout & 

Support 



versus actual, project success* 
This document is included on 



Do not download or save from tliis page, go to 
the Project Management Stage if you need a 
copy of this document. 
The Software Quality Assurance (SQA) 
Debrief is conducted at the end of the project. 
During this meeting, the Software Engineering 
Process Group (SEPG) project manager 
m the effectiveness of the 



ffi for the pr 



Its of the SQA Debrief an 



Rollout & 



Organization.il Structure Types and provides 
samples of each. These include Functional, 
Process, Product, Matrix, and 
Customer/Industry'- focused. 



Performance 
Management 
Infrastructure 
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TABLE 1 -continued 



wofttie business. The 
Balanced Scorecaid has Ave key elements: 
Feispectives, Objectives, Metrics, Targets, 



tB each best practice by KPA 
(Key Process Area). It includes references to 
templates, job aids and samples deliverables. 
Orientation Binder Template See first occurrence of Navigator Item in the See first 

Organizational Management Plan & Organize occurrence 
SEPG design Matrix Navigator 



The Software Quality Assurance (SQA) 
Debrief is conducted at the end of the project. 
Diu-ing tliis meeting, the Software Engineering 
Process Group (SEPG) project manager 

SQA process for tlie project and discusses 

executives. The results of the SQA Debrief are 
used to continuously improve tlie SQA 
process, methodology and tools. 
Moved to Peer Review design matrix. 



Moved to Commit design mi 



The Database Configurat 
details of the actual datat 



in Process Template The Converaion Proc 



what data needs to be converted, along with 
outlining the procedures that will be followed 
in converting tliat data and the controls that 
will be in place to ensure the quality and 

conversion approach will be identified along 
with mitigation strategies 
plans for each. 
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What is claimed: 

1. A system for accelerating process improvement, the 
system comprising; 

a data storage device for storing one or more files related 
to a method for accelerating process improvement, the 
method comprising a step for managing an organization 
developing a product, a step for managing a project for 
developing said product, and a step for managing the 
delivery of said product; and 

a data management system for administering said files. 

2. The system of claim 1 wherein said method fijrther 
comprising a step for managing a program for implementing 
said method. 

3. The system of claim 1 wherein one of said files contains 
infonnation related to creating a document associated with 
said method. 

4. The system of claim 3, wherein said infonnation 
includes instructions on creating said document. 

5. Tlie system of claim 3, wherein said infonnation 
includes an example of said document. 

6. The system of claim 1 further comprising a document 
management tool, wherein said document management tool 
associates a document with a step in said method. 

7. The system of claim 1 further comprising a navigator 
tool for graphically displaying one or more steps in said 
method. 

8. The system of claim 7 further comprising navigator 
data related said files, said navigator data used by said 
navigator tool. 

9. The system of claim 1 fijrther comprising: 
a plurality of data storage devices; 

and said data management system for administering said 
files further comprising a server wherein said server 
includes a database engine for storing the location of 
said files. 



10. The system of claim 9 fiirther comprising a navigator 
apphcation that accepts an input from a user identifying one 
of said files and connects the user to that file. 

11. The system of claim 10 wherein the server uses 
WebDAV to allow said user to connect to said plurality of 
data storage devices. 

12. A metliod for accelerating process improvement, the 
method comprising: 

storing data related a step for managing an organization 
developing a product, a step for managing a project for 
developing said product, and a step for managing the 
delivery of said product; and 

administering said data using a document management 
system. 

13. The method of claim 12 further comprising: 

associating a docmnent with one or actions in said step for 
managing an organization developing a product, said 
step for managing a project for developing said prod- 
uct, or said step for managing the delivery of said 
product. 

14. The method of claim 12 fiirther comprising: 

graphically displaying one or actions in said step for 
managing an organization developing a product, said 
step for managing a project for developing said prod- 
uct, or said step for managing the delivery of said 
product. 

15. ITie method of claim 1 2 wherein the said data is stored 
on a plurahty of data repositories and fi.irther comprising the 
step of allowing a user to access said data repositories using 
WebDAV. 
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